onsite
Data Engineer II, Operations - Delivery Hero SE
Data Engineer
Senior data engineer focused on building scalable data pipelines for quick commerce operations, leveraging Python, SQL, AWS, and Spark to deliver real-time insights and support business growth.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines that ingest, transform, and load large volumes of transactional data into the data warehouse.
- Optimize data models and queries for performance, ensuring low latency for real‑time analytics and reporting.
- Collaborate with product, analytics, and engineering teams to define data requirements and deliver actionable insights.
- Implement data quality checks, monitoring, and alerting using Airflow and custom scripts.
- Leverage AWS services (S3, Redshift, Glue, Lambda) to build scalable, cost‑effective data infrastructure.
Requirements
- 3+ years of experience as a data engineer in a fast‑paced e‑commerce or logistics environment.
- Proficiency in Python, SQL, and experience with Spark or similar big‑data frameworks.
- Hands‑on experience with AWS data services and orchestration tools like Airflow.
- Strong analytical mindset with a focus on data quality, performance tuning, and automation.
- Excellent communication skills and ability to work cross‑functionally in a dynamic team.
Skills
pythonsqlawsapache sparkairflow