onsite
Agentic AI Data Engineer - EXL Service
Data Engineer
Senior Agentic AI Data Engineer building scalable data platforms and AI‑driven solutions using Python, SQL, AWS, Spark, and machine learning to automate processes and enable advanced analytics.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines that ingest, transform, and store structured and unstructured data for AI models.
- Implement cloud‑native solutions on AWS (S3, Redshift, Glue, Lambda) to ensure high availability, scalability, and cost efficiency.
- Collaborate with data scientists to deploy machine learning models, monitor performance, and iterate on feature engineering.
- Optimize Spark jobs and SQL queries for performance, reducing processing time by 30%+.
- Ensure data quality, governance, and security compliance across all data assets.
Requirements
- 5+ years of experience in data engineering with a strong focus on cloud platforms.
- Proficiency in Python, SQL, and Apache Spark for ETL and data processing.
- Hands‑on experience with AWS services (S3, Redshift, Glue, Lambda, SageMaker).
- Solid understanding of machine learning workflows and model deployment.
- Excellent problem‑solving skills and ability to work cross‑functionally in a fast‑paced environment.
Skills
pythonsqlawsapache sparkmachine learning