Data Engineer

Empower Professionals Inc

Empower Professionals Inc is looking for a Data Engineer to join their team in Sunnyvale, CA. This role is vital in supporting the company's data-driven initiatives by developing and optimizing data processing workflows. The team is focused on implementing innovative solutions in a retail environment, enhancing data pipeline efficiency, and ensuring data integrity across vast datasets.

In this role you can expect to have the responsibilities:

• Develop and optimize data pipelines using GCP technology.
• Design schemas for data lakes and RDBMS platforms.
• Implement distributed data processing platforms with Hadoop, Hive, or Spark.
• Collaborate in a Scrum/Agile development environment.

This role comes with the following benefits:

This role requires you to have:

• 10 years of IT experience.
• 3 years of recent GCP experience.
• 5 years of experience with Hadoop, Hive, Spark, or Airflow.
• Experience with Python, Java, or Scala.

You would benefit from having:

• Master’s degree in Computer Science or a related field.
• Experience in test-driven development and automated testing.

Preference is given to candidates with previous experience in retail, specifically those who have worked with Walmart, indicating strong domain expertise.