onsite
Data Engineer - REWE International Dienstleistungsgesellschaft m.b.H.
Data Engineer
Build and maintain scalable data pipelines using Python, SQL, and AWS services, leveraging Spark for large‑scale processing and ensuring robust data modeling and ETL workflows.
About the role
Key Responsibilities
- Design, develop, and optimize data pipelines for ingestion, transformation, and delivery across cloud and on‑premise environments.
- Implement scalable ETL processes using Python, SQL, and Apache Spark, ensuring data quality and performance.
- Collaborate with data scientists and analysts to support data needs, providing clean, well‑documented datasets.
- Maintain and monitor data infrastructure on AWS (S3, Redshift, Glue, EMR) and troubleshoot issues.
- Document data models, pipeline logic, and best practices for future reference.
Requirements
- 3+ years of experience as a Data Engineer or similar role.
- Solid understanding of data modeling, ETL design, and data warehousing concepts.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlawsapache spark