onsite
Data Engineer - 1 & 1 Mail & Media Applications SE
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, AWS, and Spark to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and store large volumes of structured and unstructured data.
- Implement and optimize data models and schemas in relational and NoSQL databases, ensuring data quality and consistency.
- Leverage AWS services (S3, Redshift, Glue, EMR) to build scalable, cost‑effective data solutions.
- Collaborate with data scientists and analysts to provide clean, accessible data for modeling and reporting.
- Monitor pipeline performance, troubleshoot issues, and implement improvements for reliability and efficiency.
Requirements
- Proven experience as a Data Engineer or similar role, with strong programming skills in Python.
- Deep knowledge of SQL and experience with data warehousing solutions.
- Hands‑on experience with AWS data services and Spark or similar big‑data frameworks.
- Solid understanding of data modeling, ETL best practices, and data governance.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.