Senior Data Engineer (Python, Spark, AWS)
Capital One
- McLean, VA, United States
- Full-time
- No Salary Information Available
Capital One is looking for a Senior Data Engineer to join their team. In this role, you will work in a fast-paced, collaborative, and inclusive environment to solve complex business problems. You'll have the opportunity to build and optimize data pipelines, collaborate with cross-functional teams, and leverage cutting-edge technologies.
In this role you can expect to have the responsibilities:
- Build and optimize data pipelines for efficient data ingestion, transformation, and loading from various sources
- Support the design and development of scalable data architectures and systems
- Collaborate with Data Scientists, Machine Learning Engineers, Business Analysts, and Product Owners to provide efficient solutions for data exploration, analysis, and modeling
- Implement testing, validation, and pipeline observability
- Utilize Python, Scala, Spark, and various AWS services to develop modern data pipelines supporting Machine Learning and Artificial Intelligence
This role comes with the following benefits:
- Comprehensive health, financial, and other benefits
- Inclusive work environment
- Competitive compensation
- Total well-being support
This role requires you to have:
- Bachelor’s Degree
- At least 4 years of experience in application development
- At least 1 year of experience in big data technologies
You would benefit from having:
- 5+ years of experience building data pipelines using Python, Java, or Scala
- 2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
- 2+ years of experience using Spark or PySpark
- 2+ years of data warehousing experience (Redshift or Snowflake)
- 3+ years of experience with UNIX/Linux including basic commands and shell scripting
- 2+ years of experience with Agile engineering practices
Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. They promote a drug-free workplace and consider all qualified applicants with a criminal history in compliance with applicable laws. For any technical support or questions about the recruiting process, please contact Careers@capitalone.com.
The content on this page is not written or managed by Alooba. Please reach out to Capital One directly for any addtional information regarding this role.