Data Engineer

Millennium Management

Millennium Management is recruiting a Data Engineer with a passion for data transformation and analytics. The selected candidate will collaborate with a dynamic team to build scalable data pipelines and integrate large-scale datasets utilizing cloud and open-source technologies. This role focuses on constructing cloud-based analytics solutions within an agile framework, enabling effective data presentation through visual tools.

In this role you can expect to have the responsibilities:

• Develop and sustain data pipelines for analytics.
• Build system integrations using tools like RESTful APIs and Apache NiFi.
• Integrate data from various organizational sources into a data lake.
• Map data into cross-functional reports and dashboards.
• Manage data processing services on Linux servers.

This role comes with the following benefits:

• Base salary with a discretionary performance bonus.
• Comprehensive benefits package.

This role requires you to have:

• Minimum 7 years in software development.
• 5+ years in Python with pandas, SQLAlchemy, Django.
• Experience in relational and columnar databases with SQL.
• Professional knowledge of core AWS services.
• Proficiency in open-source data processing libraries such as Airflow.
• Understanding of data processing architectures.

You would benefit from having:

• Experience with cloud-based analytics platforms.
• Familiarity with DevOps practices.
• Knowledge of automated testing and data quality tools.

Salaries are specific to New York and subject to future adjustments. Compensation is decided based on experience and qualifications.