Lead Cloud Data Engineer

The Granite Group

The Granite Group is experiencing significant growth, propelling their tech team forward to meet increased demands. They are recruiting a Lead Cloud Data Engineer to collaborate closely with the Data Science Director and Head of Database Administration. This position has an essential role in developing cloud-based data solutions.

In this role you can expect to have the responsibilities:

• Design and optimize scalable data pipelines in a cloud setting.
• Implement and manage data warehouses using Azure Synapse.
• Build ETL processes with Azure, Databricks, PySpark, and SQL.
• Oversee both relational and non-relational databases for efficient data retrieval.
• Establish data security protocols.
• Collaborate with team members to align data platforms and business requirements.
• Manage large datasets using big data tooling.
• Ensure optimal performance of data infrastructure via cloud services like Azure and AWS S3.
• Lead a team of data engineers, fostering growth and improvement.

This role comes with the following benefits:

• Enhanced annual leave starting at 31 days.
• Company sick pay scheme.
• Company-paid maternity and paternity leave.
• Generous company pension scheme.
• Mental health support via EAP.
• Network of mental health first aiders.
• Reward and discount platform 'Your tomorrow'.
• Fresh fruit deliveries twice a week.
• £250 refer a friend bonus.
• Cycle to work scheme.
• Free eye test vouchers and contributions to frames.
• Regular employment engagement activities.
• Charity fundraising events.

This role requires you to have:

• 5+ years in data engineering.
• Expertise in Azure DWH and AWS Databricks.
• Proficient programming in Python/PySpark.
• Strong SQL skills with experience in relational and non-relational databases.
• Familiarity with AWS S3 and related services.

You would benefit from having:

• Experience with data streaming technologies like Kafka.
• Knowledge of graph/vector databases.
• Relevant certifications in Azure or AWS.

All roles require DBS and financial checks. Adjustments in the recruitment process are available for candidates with specific needs to ensure optimal performance. Candidates must have at least one year remaining on their visa; visa sponsorship is not provided.