onsite
Data Management Consultant / Data Engineer - nag informatik
Data Engineer
Lead end‑to‑end data engineering projects, designing scalable pipelines, optimizing data warehouses, and delivering actionable insights using Python, SQL, Spark, and AWS services.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes to ingest, transform, and load data from diverse sources into cloud data warehouses.
- Architect and optimize data models, ensuring high performance, scalability, and data quality across analytics platforms.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions and provide data governance best practices.
- Implement monitoring, logging, and automated testing to guarantee pipeline reliability and compliance with security standards.
- Mentor junior engineers, conduct code reviews, and promote continuous improvement of data engineering practices.
Requirements
- Proven experience as a data engineer or data management consultant, with strong hands‑on skills in Python, SQL, and Spark.
- Deep knowledge of cloud data platforms (AWS Redshift, S3, Glue, Athena) and data warehousing concepts.
- Solid understanding of ETL/ELT patterns, data modeling, and performance tuning.
- Excellent problem‑solving skills, ability to work independently and in cross‑functional teams.
- Strong communication skills in German and English, with a proactive, solution‑oriented mindset.
Skills
pythonsqlawsapache spark