Big Data Engineer

Limitoweb Technologies LTD

Limitoweb Technologies LTD is seeking a skilled Big Data Engineer to support their data management objectives. This role is essential for ensuring data pipelines align with business needs and maintaining system efficiency. The team collaborates with various stakeholders to optimize data availability and performance.

In this role you can expect to have the responsibilities:

• Design and maintain scalable data pipelines and data integration processes.
• Develop and optimize data models for integrity and performance.
• Collaborate with stakeholders to implement data requirements.
• Implement and maintain ETL processes for data management.
• Ensure data quality through automated testing and validation.
• Monitor and troubleshoot data pipeline performance issues.
• Document data systems and processes for knowledge sharing.

This role comes with the following benefits:

• Work schedule from Monday to Friday.

This role requires you to have:

• SQL proficiency and data warehousing concepts.
• Experience with AWS and Java for cloud solutions.
• Knowledge of Big Data technologies like Hadoop and Apache Hive.
• Familiarity with Python and Microsoft SQL Server.

You would benefit from having:

• Database design and data integration tools like Informatica.
• Analytical skills with experience in VBA, Bash, and Shell scripting.