onsite
Delivery Consultant, Data Engineering and Generative AI
AI Engineer
Lead data engineering initiatives and build generative AI solutions on AWS, leveraging Apache Spark, Python, and machine learning to deliver scalable, cloud‑native analytics pipelines for enterprise customers.
About the role
Key Responsibilities
- Design and implement end‑to‑end data pipelines using Apache Spark on AWS services such as EMR, Glue, and S3.
- Develop and deploy generative AI models and machine‑learning workflows in a cloud‑native environment.
- Collaborate with client architects and product teams to translate business requirements into scalable data engineering solutions.
- Provide technical guidance, best‑practice recommendations, and hands‑on support throughout project lifecycles.
- Automate data processing, model training, and CI/CD pipelines using Python and AWS DevOps tools.
Requirements
- 5+ years of experience in data engineering, big‑data processing, and cloud platforms, primarily AWS.
- Proficiency with Apache Spark, Python, and related data‑processing frameworks.
- Hands‑on experience building, fine‑tuning, and deploying generative AI or machine‑learning models.
- Strong understanding of cloud architecture, security, and cost‑optimization best practices.
- Excellent communication skills and ability to work directly with customers to solve complex technical challenges.
Skills
awsapache sparkpythonmachine learning