Data Engineer

Datacorns LLC

Datacorns LLC is seeking a Data Engineer with a strong focus on Azure cloud services. This role involves the construction and optimization of data workflows, particularly for the healthcare sector, utilizing advanced data science techniques and predictive analytics. The engineer will be part of a dynamic team aiming to leverage data for strategic decision-making and improve business operations.

In this role you can expect to have the responsibilities:

• Design and maintain scalable ETL/ELT pipelines in Azure for healthcare data.
• Work with diverse healthcare data types and sources.
• Implement data storage solutions using Azure technologies, including Azure Data Lake and Cosmos DB.
• Deploy machine learning models for healthcare analytics.
• Ensure data integrity and compliance with healthcare regulations.
• Collaborate with data scientists and software engineers on data solutions.
• Automate workflows using Azure Data Factory and Databricks.
• Monitor and troubleshoot data pipelines for optimal performance.

This role comes with the following benefits:

This role requires you to have:

• 5+ years of experience as a Data Engineer with Azure.
• Proficiency in SQL, Python, Spark, and Databricks.
• Experience with Azure Data Factory and Azure Synapse.
• Understanding of machine learning models in healthcare.
• Knowledge of healthcare data standards like FHIR and HL7.
• Familiarity with DevOps and CI/CD for data workflows.

You would benefit from having:

• Experience with Big Data technologies like Hadoop and Kafka.
• Knowledge of healthcare data governance and compliance.
• Azure certifications, such as Azure Data Engineer Associate.
• Understanding of cloud cost optimization.

The role requires ensuring data compliance with HIPAA and collaborating in an agile environment.