onsite
IT Data Engineer - Elbe Flugzeugwerke GmbH
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, and AWS services to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and load data from diverse sources into data lakes and warehouses.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high‑quality, reproducible datasets.
- Implement and optimize data models, schemas, and indexing strategies for performance and scalability on AWS services such as Redshift, S3, Glue, and Athena.
- Monitor pipeline health, troubleshoot issues, and implement automated alerts and logging to ensure data reliability.
- Document data architecture, pipeline workflows, and best practices for future maintenance and knowledge transfer.
Requirements
- Proven experience in Python programming and SQL querying for data manipulation and analysis.
- Hands‑on expertise with AWS data services (Redshift, S3, Glue, Athena, Lambda) and experience building serverless data pipelines.
- Strong understanding of data modeling, ETL concepts, and performance tuning in large‑scale environments.
- Experience with version control (Git), CI/CD pipelines, and automated testing for data workflows.
- Excellent problem‑solving skills, attention to detail, and ability to communicate complex technical concepts to non‑technical stakeholders.