Azure Data Engineer

United It Solutions Inc

United It Solutions Inc is looking for an Azure Data Engineer with 8 to 10 years of experience, specializing in cloud data platforms. The role requires expertise in Python, Pyspark, SQL, and enterprise-level data warehousing. The team focuses on optimizing data pipelines and ensuring data quality and integrity by working closely with business users.

In this role you can expect to have the responsibilities:

• Build and optimize data pipelines for efficient data ingestion, transformation, and loading.
• Design, develop, and deploy Spark programs in Databricks for data analysis.
• Work with Delta Lake, data integration, and data modeling in cloud environments.
• Utilize streaming technologies for data processing and work with various data structures.
• Optimize Databricks jobs and troubleshoot issues for better performance.
• Implement data management, security, and governance best practices.
• Develop enterprise-level data warehouse solutions.

This role requires you to have:

• Proficiency in Python with 5+ years of experience.
• Experience in SQL Server development of large datasets.
• Strong skills in developing ETL pipelines using Databricks Pyspark.
• Experience in cloud data warehouses like Synapse, Big Query, Redshift, or Snowflake.
• Expertise in data warehousing, OLTP, OLAP, and data modeling.
• Enterprise-level experience in cloud data platform migration with architectural skills.

You would benefit from having:

• Cloud certification(s).
• Experience with Airflow.

The role entails a fixed-term contract for 24 months with 40 expected hours per week. The position is based in Montreal, QC, with hybrid remote work arrangements.