Data Engineer-Consultant

Datavail

Datavail is dedicated to enhancing data management solutions and is seeking a Data Engineer-Consultant to collaborate with teams to develop data platform tools and integrations. The role involves optimizing data workflows and leading projects to ensure efficient data processing and system transparency.

In this role you can expect to have the responsibilities:

• Collaborate with architects to design data platform tools and integrations.
• Develop data lake and lake house architectures.
• Implement streaming data architectures and integrate with software products.
• Work with data scientists and stakeholders to develop optimal solutions.
• Build governance into technical solutions with architects.
• Maintain systems for transparency and observability.
• Promote engineering patterns and perform code reviews.
• MVP data products and maintain data models.
• Provide mentorship to product and data engineers.
• Identify performance bottlenecks and optimize data pipelines.
• Participate in story grooming and task management.

This role requires you to have:

• 7+ years of relevant experience.
• Degree in computer-related field or equivalent experience.
• Proficiency in a programming language like Python, Scala, or Java.
• Knowledge of object/design patterns.
• Experience with Apache Spark and data lake principles.
• Understanding of ELT/ETL patterns in distributed systems.
• Familiarity with data quality and observability tooling.
• Knowledge of SDLC and related tools.

You would benefit from having:

• Master's degree is a plus.