Junior Data Engineer

Kpler

Kpler aids clients in navigating complex markets by simplifying global trade information in commodities, energy, and maritime sectors. Since 2014, the company has been committed to delivering top-tier intelligence through user-friendly platforms. With a diverse team of over 600 experts, Kpler transforms complex data into actionable strategies, ensuring clients remain competitive. The Junior Data Engineer role in the Commodities Market Data team is essential for managing maritime trade data to offer clients a real-time, accurate view of global trade.

In this role you can expect to have the responsibilities:

• Quickly understand the domain and work independently on tasks with guidance for complex projects
• Collaborate with engineers to develop and implement data ingestion and distribution pipelines
• Troubleshoot and optimize existing workflows to enhance performance and ensure data accuracy
• Show strong analytical and debugging skills with a proactive learning approach

This role requires you to have:

• Proficiency in Python or similar scripting languages, with experience in data manipulation and transformation
• Knowledge of SQL, RDBMS, or Big Data technologies
• Understanding of data integration, ETL processes, and batch/streaming data processing
• Comfortable with Git, code reviews, and Agile methodologies
• Familiarity with containerization and orchestration tools like Docker, Kubernetes, Airflow

You would benefit from having:

• Experience with Scala
• Familiarity with Machine Learning, especially NLP
• Experience with Kafka or similar message-broker technologies
• Exposure to Elasticsearch
• Experience with AWS or other cloud providers, using Terraform

Kpler prides itself on being an inclusive and diverse employer, welcoming individuals from various backgrounds and perspectives. It encourages applications from those who do not meet every job requirement, focusing on adding diverse perspectives to the team. Kpler is an equal opportunity employer, fostering a fair and inclusive work environment.