Principal Data Engineer

Commonwealth Bank

Commonwealth Bank is seeking a Principal Data Engineer to join their high-performing team focused on enhancing engineering standards and instrumentations. This role is crucial for supporting the Customer Master Data Management Platform and driving improvement of data solutions across the bank. You will work closely with engineering and technical teams to deliver high-quality data management services.

In this role you can expect to have the responsibilities:

• Develop and implement end-to-end data-centric engineering solutions.
• Design and handle architecture for data pipelines and analytics.
• Lead the execution and communication of ETL strategies.
• Develop data staging and architectures while managing internal and external interfaces.
• Collaborate across teams to ensure compliance with guidelines and standards.
• Participate in agile project lifecycles and DevSecOps practices.
• Design complex technical solutions and consumption patterns.
• Build capabilities supporting 'Always On' and 'zero downtimes' principles.

This role comes with the following benefits:

• Flexibility to balance remote and in-office work.
• Various flexible working options including part-time and job share.
• Support for career growth and tackling new opportunities.

This role requires you to have:

• Experience with Apache Flink, Beam, AWS Glue, and big data technologies.
• Programming proficiency in Java and Python.
• Cloud infrastructure expertise, particularly with AWS.
• Hands-on experience in NoSQL databases, SQL tuning, and data modelling.
• Understanding of event-driven technologies such as Kafka.

You would benefit from having:

• AWS associate level certification.
• Experience with GDE, ADC, Express-IT, and other ETL tools.
• Knowledge of test automation for ETL/ELT and CI/CD pipelines with GitHub Actions.

Commonwealth Bank embraces flexibility and empowers employees to do their best work. They support diversity and accessibility, providing resources for employees who need accommodations.