Data Engineer

Eedi

Eedi aims to transform education for a billion students by 2030. The company is pioneering an adaptive learning platform through harnessing vast data collections over ten years, supported by a significant grant. Their ML model is on the brink of completion, collaborating with top educational entities to redefine AI tutoring.

In this role you can expect to have the responsibilities:

• Design, build, and maintain scalable data pipelines and infrastructure.
• Collaborate with data science teams to standardise processes.
• Develop unified methods to access various data sources.
• Implement secure ETL processes and establish data isolation strategies.
• Enhance data quality and support machine learning advancements.
• Introduce metadata structures and improve efficiency across products.
• Manage vector databases and investigate streaming data solutions.

This role comes with the following benefits:

• Competitive salary plus stock options and a generous pension.
• 30 days holiday plus a Christmas break.
• Cycle-to-work scheme.
• Home office budget for equipment.
• Flexible working policies.
• Quarterly off-site retreats.
• Learning budget.
• Four-day work week post-probation.

This role requires you to have:

• 5+ years in data engineering with large-scale data pipelines.
• Proficient in Python and SQL for data processing.
• Expertise in cloud-based data infrastructure, specifically Azure.
• Experience with data orchestration tools like Apache Airflow.
• Understanding of distributed data processing frameworks like Spark.
• Experience with data lakes, data warehouses, and relational databases.
• Strong knowledge of ETL/ELT practices and data modelling.

You would benefit from having:

• Experience in Edtech or startup environments.
• Familiarity with graph databases and knowledge graphs.
• Background in real-time data streaming solutions.
• Understanding of MLOps practices.
• Contributions to open-source projects or technical publications.
• Experience with Infrastructure as Code (IaC) tools like Terraform.

Eedi is committed to diversity and inclusion in the workplace, seeking individuals from varied backgrounds and experiences to foster an inclusive environment. Please note the application deadline was April 18th.