onsite
Lead Generative AI Data Engineer III
AI Engineer
Lead the design and implementation of scalable generative AI data pipelines using Docker and Kubernetes, driving innovation in AI-driven data solutions.
About the role
Key Responsibilities
- Architect and maintain end‑to‑end generative AI data pipelines that ingest, transform, and serve large volumes of structured and unstructured data.
- Leverage Docker and Kubernetes to containerize services, ensuring high availability, scalability, and efficient resource utilization.
- Collaborate with data scientists and ML engineers to integrate model outputs into production workflows, optimizing latency and throughput.
- Implement robust monitoring, logging, and alerting for pipeline health and performance.
- Mentor junior engineers, conduct code reviews, and promote best practices in data engineering and DevOps.
Requirements
- 5+ years of experience in data engineering with a focus on AI/ML pipelines.
- Proficiency in Python, Docker, Kubernetes, and cloud-native data services.
- Strong understanding of generative AI models and their data requirements.
- Experience with CI/CD pipelines and automated testing for data workflows.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
generative aidockerkubernetespython