onsite
Senior Consultant Data Engineering & AI - Bechtle AG
Software Engineer
Lead end‑to‑end data engineering and AI projects, designing scalable pipelines, deploying ML models, and optimizing cloud data solutions using Python, SQL, AWS, Spark, and Airflow.
About the role
Key Responsibilities
- Architect and implement robust data pipelines and lakehouse solutions on AWS, ensuring high availability and performance.
- Design, develop, and deploy machine learning models, integrating them into production workflows.
- Collaborate with cross‑functional teams to translate business requirements into scalable data solutions.
- Mentor junior engineers, conduct code reviews, and promote best practices in data engineering and AI.
- Monitor and optimize pipeline performance, troubleshoot issues, and implement continuous improvement strategies.
Requirements
- 5+ years of experience in data engineering and AI, with a strong background in Python and SQL.
- Proven expertise in AWS services (S3, Redshift, Glue, EMR) and big data frameworks (Spark, Flink).
- Hands‑on experience with ML frameworks (scikit‑learn, TensorFlow, PyTorch) and model deployment.
- Solid understanding of data architecture, ETL processes, and data governance.
- Excellent communication skills and a proactive, solution‑oriented mindset.
Skills
pythonsqlawsmachine learningapache sparkairflow