onsite
Staff Data Engineer - Deutsche Lufthansa AG
Data Engineer
Lead complex data engineering initiatives, architecting scalable pipelines on AWS, leveraging Python, Spark, and SQL to deliver high‑quality data solutions for enterprise analytics.
About the role
Key Responsibilities
- Design, develop, and maintain large‑scale data pipelines using Python, Spark, and SQL on AWS infrastructure.
- Collaborate with data scientists and product teams to translate business requirements into robust data models and ETL processes.
- Optimize performance and reliability of data workflows, ensuring data quality, lineage, and compliance.
- Mentor junior engineers, conduct code reviews, and promote best practices in data engineering.
- Stay current with emerging data technologies and evaluate their applicability to business needs.
Requirements
- 10+ years of experience in data engineering or related roles.
- Proficiency in Python, SQL, and Apache Spark for large‑scale data processing.
- Hands‑on experience with AWS services (S3, Redshift, Glue, EMR).
- Strong understanding of data modeling, ETL design, and data governance.
- Excellent problem‑solving skills and ability to work in a fast‑paced environment.
Skills
pythonsqlapache sparkaws