remoteonsite
EY - GDS Consulting - AIA -Data Engineer -ML Support - Senior
Data Engineer
Senior Data Engineer – ML Support building scalable data pipelines and ML infrastructure on AWS, leveraging Python, Spark, and SQL to enable advanced analytics for enterprise clients.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines and ETL workflows using Python, Spark, and SQL on AWS services (Glue, Redshift, S3).
- Collaborate with data scientists to operationalize machine learning models, ensuring reproducibility and performance at scale.
- Implement data quality, monitoring, and governance frameworks to support compliance and audit requirements.
- Optimize data storage and processing for cost and performance, leveraging best practices in cloud architecture.
- Provide technical mentorship to junior engineers and cross‑functional teams.
Requirements
- 7–10+ years of experience in data engineering and ML support roles.
- Proficiency in Python, SQL, and Spark for data processing.
- Hands‑on experience with AWS data services (Glue, Redshift, S3, EMR).
- Strong understanding of ML model deployment, monitoring, and lifecycle management.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
pythonsqlawsmachine learning