Data Engineer

Mitra Innovation Ltd

Mitra AI, a prominent global technology firm, offers cutting-edge AI solutions, cloud engineering, and workflow automation. With over a decade of service across diverse industries, Mitra is dedicated to helping businesses optimize their operations. They are seeking a Data Engineer to enhance their data-driven decision-making capabilities.

In this role you can expect to have the responsibilities:

• Develop and optimize ETL/ELT pipelines with Databricks, PySpark, and SQL.
• Migrate data from on-premises to AWS cloud, ensuring high integrity and performance.
• Design scalable data models for analytics and business intelligence support.
• Manage and innovate stored procedures for efficient data processing.
• Integrate and transform data across diverse cloud and on-premises sources.
• Improve data structuring for enhanced reporting capabilities.
• Optimize AWS data architecture, including S3, Redshift, Glue, and Lambda.
• Ensure data quality, governance, and security throughout the pipeline.
• Collaborate with data scientists and analysts to extract insights.

This role requires you to have:

• 5+ years in Data Engineering with a cloud platform focus.
• Expertise in Databricks, PySpark, SQL, and Delta Lake.
• AWS proficiency, including S3, Redshift, Glue, Lambda, and Athena.
• Advanced Python and SQL skills with stored procedure proficiency.
• Experience in large-scale data migrations to the cloud.
• Data modeling, warehousing, and analytics expertise.
• Strong data integration, transformation, and ETL pipeline experience.
• Understanding of data governance, security, and performance optimization.