Senior Data Engineer

EnergyAustralia

EnergyAustralia is looking for a Senior Data Engineer to collaborate with the Data Product team in delivering robust data solutions. This role involves designing and deploying data products to unlock value for the company, with an emphasis on AWS services. This position is crucial for supporting data architecture and integrating diverse data sources.

In this role you can expect to have the responsibilities:

• Implement ETL/data import and interface mechanisms using databases, APIs, and caches.
• Develop and maintain data products and platform support.
• Formulate and support data solutions and architecture while delivering new data products.
• Conduct data mapping, profiling, and design data flows in response to business requirements.
• Utilize DevSecOps and CI/CD workflows for infrastructure and data pipeline development.

This role comes with the following benefits:

• Annual performance bonus
• Discounts on gas and electricity
• Flexible working arrangements through the Energise Program
• Inclusive company culture
• State-of-the-art Melbourne office
• In-house café and onsite tech support

This role requires you to have:

• Engineering experience in Agile or DevOps environments
• AWS cloud data platforms expertise with S3, EMR/EC2, Lambda, Redshift
• Proficiency in data modelling with tools like DBT or AWS Glue
• Experience with streaming technologies like Kafka or Spark streaming
• Strong skills in SQL, Java, Python, R, PySpark

You would benefit from having:

• Experience with orchestration services like Apache Airflow
• Stakeholder management and communication skills

EnergyAustralia fosters an inclusive culture, promoting diversity through initiatives like the PRISM network for LGBTQ+ inclusion and a Reconciliation Action Plan for engaging with Aboriginal and Torres Strait Islander communities.