Lead Data Engineer

CWP Energy

CWP Energy Trading is at the forefront of combining energy analytics with fintech, dedicated to optimizing power markets through insightful data analytics. They seek a Lead Data Engineer to enhance the company's scalable data infrastructure, guide their data governance strategy, and collaborate with multiple teams to meet data needs.

In this role you can expect to have the responsibilities:

• Construct and manage data pipelines for multiple data sources.
• Develop and update a comprehensive data catalog.
• Support data users with structured analytics and ad-hoc querying.
• Manage the use of infrastructure-as-code tools for data projects.
• Implement and support batch processing and real-time streaming solutions.
• Collaborate with teams to prioritize data needs.
• Lead the development team with best practices and architectural guidance.
• Communicate with stakeholders on data availability and system performance.

This role comes with the following benefits:

• Dynamic environment encouraging innovation.
• Results-driven corporate culture.
• Comprehensive group insurance and RRSP contribution.
• Vacation policy from the start.
• Public transit incentive program.
• Give & Match program.
• Flexible hours with hybrid work options.
• Modern office amenities including a gym and showers.

This role requires you to have:

• 8+ years in data engineering or similar fields.
• Expertise in data warehousing and data governance.
• Proficiency in Python and SQL.
• Experience with analytical databases like BigQuery, Snowflake, or Databricks.
• Knowledge of ETL/ELT pipelines and workflow orchestration tools.
• Understanding of cloud computing platforms, including GCP.
• Experience as a Tech Lead or Team Lead.

You would benefit from having:

• Experience with real-time data streaming technologies.
• Familiarity with AI/ML frameworks and tools.
• Experience with large language models and model deployment.

CWP Energy collects applicant data via a secure system, with restricted access. They store data like CVs and interview notes and allow consent withdrawal upon request.