Data Engineer

Annex IT Solutions

Annex IT Solutions is looking for a Senior Data Engineer to join their dynamic team. In this role, the candidate will be instrumental in crafting scalable data pipelines and architectures. Collaborating with data scientists and analysts, the engineer will facilitate efficient data processing and analytics that propel business insights.

In this role you can expect to have the responsibilities:

• Design, develop, and maintain scalable and efficient data pipelines.
• Architect ETL/ELT processes for diverse data sources.
• Optimize database and query performance for big data processing.
• Utilize cloud platforms such as AWS, GCP, or Azure for data management.
• Implement and uphold data warehousing solutions with technologies like Snowflake or Redshift.
• Develop data governance, quality, and security best practices.
• Collaborate with data scientists for data availability in advanced analytics.
• Troubleshoot data pipeline failures and performance issues.

This role comes with the following benefits:

• Competitive salary with bonuses based on performance.
• Comprehensive health, dental, and vision insurance.
• Opportunities for professional development and training.
• Flexible work environment with remote working options.

This role requires you to have:

• 5+ years of experience in data engineering.
• Proficiency in SQL and Python/Scala/Java.
• Experience with ETL tools like Airflow or Apache Spark.
• Strong knowledge of cloud services like AWS Glue or Google Cloud Dataflow.
• Experience with data warehousing technologies such as Snowflake.
• Familiarity with real-time data processing; Kafka, Flink.

You would benefit from having:

• Experience with machine learning pipelines and MLOps.
• Knowledge of streaming technologies and event-driven architectures.
• Experience in DevOps and Agile environments.

The position offers a Monday to Friday schedule and includes various forms of additional pay such as bonus and commission. The expected start date is April 10, 2025.