onsite
Agentic AI Data Engineer - EXL
Data Engineer
Senior data engineer focused on building AI‑driven data platforms using Python, SQL, AWS, and Spark to automate analytics and support business decisions.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines that ingest, transform, and store large volumes of structured and unstructured data.
- Implement machine learning workflows and integrate AI models into production data pipelines to enable automated decision‑making.
- Leverage AWS services (S3, Redshift, Glue, Lambda) to build cloud‑native data solutions and ensure high availability and security.
- Collaborate with data scientists, product managers, and stakeholders to translate business requirements into technical specifications.
- Optimize query performance, monitor pipeline health, and troubleshoot issues across the data stack.
Requirements
- 5+ years of experience in data engineering with a strong background in Python and SQL.
- Proficiency with Apache Spark and distributed data processing frameworks.
- Hands‑on experience deploying and managing data solutions on AWS.
- Solid understanding of machine learning concepts and model deployment pipelines.
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
Skills
pythonsqlawsapache sparkmachine learning