Senior Data Engineer

Commonwealth Bank

Commonwealth Bank, with one of the largest and most advanced Data Engineering teams in the country, is looking for skilled individuals to join their Chief Data and Analytics Office. The team focuses on continually improving the bank’s data-driven initiatives to enhance customer financial well-being through strategic and competitive data solutions.

In this role you can expect to have the responsibilities:

• Design and implement next-generation data platforms and pipeline solutions across the bank.
• Engage with wider engineering talent to contribute and learn.
• Drive high-quality outcomes through state-of-the-art coding practices.
• Create technology blueprints and engineering roadmaps for data transformation.
• Lead a culture championing quality, excellence, and openness.
• Solve complex data problems by thinking creatively and pushing boundaries.

This role comes with the following benefits:

• Flexible work arrangements across engineering hubs in Sydney
• Inclusive and diverse work environment
• Opportunities to tackle new challenges and develop professionally

This role requires you to have:

• Experience with AWS data platforms including Glue, Lambda, Redshift, Athena, Kinesis, EMR
• Strong expertise in Python, SQL, Spark, Scala
• Experience with data governance and security, including AWS DataZone and Lake Formation
• Experience in building data lake frameworks with languages like Scala, PySpark, or Python
• Experience in data security and management

You would benefit from having:

• Experience with Terraform, CloudFormation, GitOps, serverless frameworks
• Ability to optimize ETL jobs and query performance
• Exposure to API Gateway and data monetization strategies
• Experience creating Python/Scala functions and libraries for pipeline generation

Commonwealth Bank values a respectful and flexible workplace where diverse backgrounds are embraced. The company is committed to accessibility and provides support for those facing challenges with the application process.