onsite
Data Engineer - Reiser Simulation and Training GmbH
Data Engineer
Build and maintain scalable data pipelines, orchestrate workflows, and optimize data storage using Python, SQL, AWS, Spark, Docker, and Airflow to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines that ingest, transform, and load data from diverse sources into cloud data warehouses.
- Implement and manage data orchestration workflows using Airflow, ensuring reliability, scalability, and observability.
- Optimize data models and queries in SQL and Spark to improve performance and reduce costs.
- Collaborate with data scientists and analysts to understand data requirements and deliver high‑quality datasets.
- Monitor pipeline health, troubleshoot issues, and implement automated alerts and recovery mechanisms.
- Document architecture, processes, and best practices for internal teams.
Requirements
- 3+ years of experience as a data engineer or similar role.
Skills
pythonsqlawsapache sparkdockerairflow