onsite
Data Engineer - Data Platform - EDEKA IT Stiftung & Co. OHG
Data Engineer
Lead the design, development, and maintenance of a scalable data platform using Python, SQL, and AWS services, ensuring high-quality data pipelines and robust data models for enterprise analytics.
About the role
Key Responsibilities
- Design, implement, and optimize data pipelines using Python, SQL, and Spark on AWS infrastructure.
- Develop and maintain data models, ensuring data quality, consistency, and accessibility across the organization.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable data solutions.
- Monitor, troubleshoot, and improve pipeline performance, implementing best practices for reliability and scalability.
- Document architecture, processes, and data lineage to support governance and compliance.
Requirements
- Proven experience as a Data Engineer or similar role, with strong Python and SQL skills.
- Hands‑on experience with AWS services (S3, Redshift, Glue, EMR) and Spark-based ETL.
- Solid understanding of data modeling, warehousing concepts, and data governance.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.
- Strong communication skills in German and English.