Senior Data Engineer

Stream Systems Ltd.

Stream Systems Ltd. is at the forefront of technology, empowering businesses with AI, machine learning, and simulation through their SimOpti platform. This fast-growing company is seeking a Data Engineer who will play a crucial role during a pivotal expansion phase, contributing to new product development and enhancements. The position reports to the Software Development Manager and works directly with the Platform Owner.

In this role you can expect to have the responsibilities:

• Design and implement data ingestion and integration solutions for on-prem and cloud (AWS) platforms.
• Build and manage ETL processes and integrate data from multiple sources.
• Oversee data quality monitoring, working with QA teams.
• Create custom data models for BI reporting and machine learning.
• Leverage best practices for scalable and reliable data pipelines.
• Define and manage relational and data warehouse structures.
• Collaborate with Simulation Analysts and Data Scientists on AI/ML solutions.
• Translate data requirements into detailed designs.
• Define best practices for data governance and extraction.

This role comes with the following benefits:

• Extended health care and dental insurance.
• Long-term disability, AD&D, and life insurance for employees and dependents.
• A flexible work environment within a passionate team.

This role requires you to have:

• Experience in STEM fields or equivalent data-centric roles.
• Proficiency in designing data pipeline solutions with big data technologies.
• Working proficiency in SQL, Python, Java, and API development with GraphQL.

You would benefit from having:

• Experience with messaging platforms like Pulsar, RabbitMQ, and Kafka.
• Proficiency in data ingestion tools such as Airbyte, DBT, and Databricks.
• Functional experience with IntelliJ/DataGrip, Jira, Confluence, Bitbucket, and Jenkins.

Candidates must pass a background check due to the handling of customer Intellectual Property. The company offers a collaborative culture with hybrid work flexibility.