onsite
Experienced Data Scientist - Generative AI
Data Scientist
Lead the design and deployment of generative AI solutions using Apache Spark and Docker, driving AI model containerization and scalable production workflows.
About the role
Key Responsibilities
- Architect and implement end‑to‑end generative AI pipelines on Apache Spark, ensuring high performance and scalability.
- Containerize AI models and services with Docker, creating reproducible and portable deployments.
- Collaborate with data engineering and DevOps teams to integrate AI workloads into CI/CD pipelines.
- Optimize model inference and training workloads for cloud and on‑prem environments.
- Document best practices, design patterns, and operational guidelines for AI model lifecycle management.
Requirements
- Proven experience with Apache Spark and large‑scale data processing.
- Strong background in generative AI techniques and frameworks.
- Hands‑on expertise in Docker and container orchestration.
- Solid understanding of AI model deployment, monitoring, and maintenance.
- Excellent problem‑solving skills and ability to work cross‑functionally.
Skills
apache sparkdockergenerative ai