Senior Data Engineer

CircleCI

CircleCI, a leading CI/CD platform, is looking for a Senior Data Engineer to join their Data Platform and Solutions team. This team is crucial in building a data-driven environment to support AI/ML applications and business objectives. The role involves developing and maintaining data systems that drive reporting, applications, and API integration.

In this role you can expect to have the responsibilities:

• Design efficient data architectures enabling smooth data flow.
• Build and manage event-based logging for comprehensive data capture.
• Establish data contracts to ensure data quality and consistency.
• Optimize data infrastructure to balance cost and performance.
• Create and maintain data pipelines with modern tools.
• Collaborate with analytics engineers for reliable data availability.
• Evaluate and implement new data tools and technologies as necessary.

This role comes with the following benefits:

• Reasonable accommodation for individuals with disabilities during the employment process.
• Equal Opportunity and Affirmative Action employer policies.

This role requires you to have:

• Proficient in Python and SQL.
• Experience with data warehousing solutions, especially Snowflake.
• Understanding of PostgreSQL and database systems.
• Hand-on experience with data integration tools like Fivetran.
• Knowledge of CI tools such as CircleCI or dbtCloud.
• Familiarity with data orchestration platforms like Apache Airflow.
• Experience with data transformation tools such as dbt.
• Background in data modeling and architecture design.

You would benefit from having:

• Experience as a founding member of a data engineering team.
• Background in data security and compliance.
• Experience with batch and microbatch processing systems.
• Knowledge of data observability tools.
• Experience with GPU management and optimization.
• Understanding of ML model versioning and experiment tracking.

CircleCI encourages a diverse workplace, supporting candidates from various backgrounds. The company provides reasonable accommodations for individuals with disabilities and ensures a discrimination-free environment.