onsite
Senior Data Engineer - Deichmann SE
Data Engineer
Lead end‑to‑end data pipeline development, architecting scalable solutions on AWS, leveraging Python, Spark, and SQL to transform and model large datasets for analytics and machine learning.
About the role
Key Responsibilities
- Design, build, and maintain robust data pipelines using Python, Spark, and SQL on AWS services (S3, Redshift, Glue).
- Implement data modeling and schema design to support analytics and ML workloads.
- Optimize ETL processes for performance, reliability, and cost efficiency.
- Collaborate with data scientists and business stakeholders to translate requirements into technical solutions.
- Ensure data quality, governance, and security across the data lifecycle.
Requirements
- 5+ years of experience in data engineering or related roles.
- Strong proficiency in Python, SQL, and Apache Spark.
- Hands‑on experience with AWS data services (S3, Redshift, Glue, Athena).
- Solid understanding of data modeling, ETL best practices, and big‑data architectures.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythonsqlawsapache spark