Lead Data Engineer (Python, AWS, Kafka)

Capital One

Capital One, headquartered in Chicago, Illinois, is at the forefront of technological innovation. They are looking for a Lead Data Engineer who thrives on challenges and enjoys crafting solutions in a dynamic, collaborative environment. This role is pivotal to the company’s mission to harness data and technology to meet customer needs.

In this role you can expect to have the responsibilities:

• Collaborate with Agile teams for solution design, development, testing, and support.
• Work alongside developers skilled in machine learning and distributed systems.
• Utilize Java, Scala, and Python for development, and employ RDBMS and NoSQL databases.
• Engage with tech communities and mentor engineering peers.
• Partner with digital product managers to create impactful cloud-based solutions.
• Conduct rigorous code design tests and peer reviews.

This role comes with the following benefits:

• Performance-based incentives including cash bonuses and long-term incentives
• Competitive health, financial, and other inclusive benefits

This role requires you to have:

• Bachelor’s Degree
• 4 years experience in application development
• 2 years experience in big data technologies
• 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)

You would benefit from having:

• 7+ years in application development (Python, SQL, Scala, or Java)
• 4+ years with public cloud services
• 4+ years with tools like Hadoop, Kafka, Spark
• Real-time data processing experience
• NoSQL and data warehousing expertise
• UNIX/Linux experience and Agile practices

Capital One is committed to diversity and inclusion, offering equal employment opportunities regardless of personal backgrounds. They maintain a drug-free workplace and consider applicants with a criminal history as per applicable laws.