onsite
AI Data Engineer - ALTEN Consulting Services GmbH Stuttgart
Data Engineer
AI Data Engineer responsible for designing, building, and maintaining scalable data pipelines that support machine learning workflows, leveraging Python, SQL, Spark, and AWS services to ingest, transform, and serve high‑quality data for AI models.
About the role
Key Responsibilities
- Design, develop, and optimize data pipelines for large‑scale AI and machine learning projects.
- Implement data ingestion, transformation, and storage solutions using Python, SQL, and Spark.
- Collaborate with data scientists to ensure data quality, consistency, and accessibility for model training.
- Deploy and manage data infrastructure on AWS (S3, Redshift, EMR, Glue).
- Monitor pipeline performance, troubleshoot issues, and implement improvements.
Requirements
- Strong programming skills in Python and SQL.
- Experience with big data technologies such as Spark and Hadoop.
- Hands‑on knowledge of AWS data services (S3, Redshift, Glue, EMR).
- Solid understanding of data modeling, ETL processes, and data quality practices.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlmachine learningaws