Data Engineer

TalentWiseCA Inc

TalentWiseCA Inc is a progressive company looking for a Data Engineer to enhance its business intelligence capabilities through innovative data solutions. The role involves collaboration with cross-functional teams to ensure data reliability and accessibility.

In this role you can expect to have the responsibilities:

• Design and optimize scalable data pipelines and systems
• Collect, store, and transform large volumes of data
• Collaborate with data scientists, analysts, and engineers to ensure data integrity
• Use modern data processing technologies like Hadoop, Spark, and Kafka
• Maintain and monitor data pipelines for efficiency and reliability
• Manage data in relational and NoSQL databases
• Implement ETL processes for data integration and analysis

This role comes with the following benefits:

• Overtime pay
• Flexible remote work schedule

This role requires you to have:

• Data engineering experience with a focus on data pipelines
• Proficiency in Python, SQL, and Scala
• Familiarity with Hadoop, Spark, and Kafka
• Experience with relational and NoSQL database management
• Understanding of cloud-based data platforms like AWS, Google Cloud, or Azure
• Strong problem-solving skills and attention to detail

You would benefit from having:

• Experience with ETL tools like Apache Airflow, Talend, or Informatica
• Familiarity with data warehousing concepts
• Experience with containerization using Docker or Kubernetes