Data Engineer - Machine Learning

Proofpoint

Proofpoint, a prominent cybersecurity company, protects organizations by focusing on people-centric security solutions. Their internal AI Forge team, located in Cork, Ireland, is dedicated to advancing machine learning capabilities and is currently expanding. The team is made up of machine learning experts who are engaged in cutting-edge research and development. They are looking for talented individuals to contribute to data-driven product features designed to enhance security solutions.

In this role you can expect to have the responsibilities:

• Design and implement scalable data pipelines for processing cybersecurity data.
• Develop distributed training architectures for efficient multi-GPU model training.
• Ensure data integrity through transformation and validation techniques.
• Work in compliance with data handling privacy standards.
• Optimize pipelines for high-throughput AI model training.
• Collaborate with AI and infrastructure teams to align data processing with AI goals.
• Utilize distributed computing frameworks for data processing across cloud environments.
• Monitor and track data lineage and pipeline performance.

This role comes with the following benefits:

This role requires you to have:

• Proficiency in Python, Go, or Java for developing data pipelines.
• Experience with data pipeline frameworks like Apache Kafka or Spark.
• Knowledge of distributed computing architectures for AI training.
• Familiarity with cloud data storage solutions like AWS S3 or GCP BigQuery.
• Understanding of data security and encryption techniques.

You would benefit from having:

• Expertise in high-scale distributed systems.
• Experience with privacy-preserving techniques.
• Background in scalable compute architectures for AI training.

Proofpoint is invested in creating an enthusiastic and growth-driven work environment. They welcome candidates from various experience levels.