AWS Data Engineer (Contractor)

Spark Digital and Analytics

Spark Digital and Analytics is a leader in innovation, driving business success through unparalleled data expertise. They seek a highly skilled AWS Data Engineer to join their team and propel the business landscape forward with cutting-edge data-driven solutions.

In this role you can expect to have the responsibilities:

• Design and develop scalable data pipelines using AWS Glue.
• Manage and optimise Redshift clusters for high performance.
• Implement serverless workflows via AWS Lambda.
• Ensure timely execution of data workflows with Apache Airflow.
• Oversee data versioning with Apache Hudi.
• Implement security through IAM policies and AWS Lake Formation.
• Collaborate with data scientists to address their data needs.
• Monitor and troubleshoot data workflows for reliability.
• Document workflows and best practices for knowledge sharing.

This role comes with the following benefits:

• Flexible hybrid work arrangement with strong remote support.
• Collaborative and innovative team environment.
• Opportunities for networking and dynamic team meetups.

This role requires you to have:

• 3+ years experience as a Data Engineer focused on AWS technologies.
• Strong expertise in AWS Glue, Redshift, and Lambda.
• Experience with Apache Airflow and Hudi.
• Proficiency in Python and SQL.
• Excellent problem-solving and communication skills.

You would benefit from having:

• Bachelor’s degree in Computer Science or related field.
• 1+ years experience with DBT.
• Knowledge of AWS Lake Formation and IAM.