Data Engineer

Scrumconnect Consultancy

Scrumconnect Consultancy, based in Staines, Surrey, is looking for an experienced Data Engineer. This role focuses on designing and maintaining efficient data pipelines and storage systems to enable data-driven initiatives. The successful candidate will have significant experience working with SQL, Python, and Microsoft Azure within a supportive team environment.

In this role you can expect to have the responsibilities:

• Design and develop data pipelines for integration and workflow optimization.
• Utilize SQL to extract, transform, and load data efficiently.
• Create and maintain data processing scripts and tools using Python.
• Develop cloud-based data solutions utilizing Microsoft Azure services.
• Ensure data quality through rigorous testing, monitoring, and validation.
• Collaborate with stakeholders to define requirements and deliver insights.
• Implement best practices in data security and governance.
• Monitor data workflows to ensure performance and reliability.

This role comes with the following benefits:

This role requires you to have:

• 5+ years as a Data Engineer with a proven track record.
• 3+ years of experience with SQL, Python, and Microsoft Azure.
• Skill in building scalable data architectures.
• Problem-solving abilities and expertise in Agile methodologies.

You would benefit from having:

• Knowledge of data visualization tools such as Power BI or Tableau.
• Familiarity with DevOps practices, including CI/CD for data workflows.
• Certifications in Microsoft Azure.
• Understanding of distributed computing frameworks like Spark.

The role is located in Staines, Surrey, with a focus on data security and compliance.