Senior Data Engineer

The National Archives, UK

The National Archives, an institution with nearly 200 years of history, aims to evolve as a 21st-century national archive. Known for being inclusive, entrepreneurial, and disruptive, they are on a mission to transform and preserve UK’s digital records. Senior Data Engineers join this mission by designing data infrastructures with cutting-edge technology, ensuring the data remains secure and usable.

In this role you can expect to have the responsibilities:

• Design and optimize scalable data platforms for digital archiving.
• Automate data processing tasks including cleansing and transformation.
• Ensure secure data processes and manage data migrations.
• Collaborate on data strategy and champion data governance practices.
• Provide technical consultancy and mentor junior staff.

This role comes with the following benefits:

• Generous pension and annual leave entitlement.
• Access to sports and social club facilities and onsite gym.
• Discounted rates at onsite café.
• Opportunities for technical, leadership training, and career development.

This role requires you to have:

• Proficient in Python, SQL, SPARQL, and Shell scripting.
• Expertise in data models and formats like JSON, XML, CSV, and RDF.
• Experience with large-scale data querying and integration.
• Strong problem-solving skills for complex data challenges.
• Collaboration and stakeholder engagement abilities.

You would benefit from having:

• Experience with AWS environments.
• Familiarity with Agile methodologies.
• Understanding of probabilistic and statistical techniques.

Security clearance is required for this role, and candidates must have been resident in the UK for the last three years. The position supports hybrid working, requiring at least 60% on-site presence. The National Archives offers a supportive environment with a commitment to diversity and equal opportunities.