onsite
Senior AI & Data Platform Engineer - BMW AG
Data Engineer
Lead the design and deployment of scalable AI and data pipelines using Python, Machine Learning, and AWS services, ensuring high performance and reliability across the organization.
About the role
Key Responsibilities
- Architect, develop, and maintain end‑to‑end AI and data pipelines on AWS, leveraging services such as S3, Redshift, SageMaker, and EMR.
- Implement scalable data processing workflows with Apache Spark and Kubernetes, ensuring optimal resource utilization and fault tolerance.
- Collaborate with data scientists to translate ML models into production‑ready services, integrating them into the platform via RESTful APIs.
- Monitor pipeline performance, troubleshoot issues, and continuously improve data quality and processing efficiency.
- Document architecture, code, and best practices, and mentor junior engineers on platform standards.
Requirements
- 5+ years of experience in data engineering and AI platform development.
- Proficiency in Python, SQL, and distributed computing frameworks (Spark, Flink).
- Hands‑on experience with AWS services (S3, Redshift, SageMaker, EMR, Lambda).
- Strong understanding of container orchestration (Kubernetes) and CI/CD pipelines.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythonmachine learningawsapache sparkkubernetes