onsite
Data Engineer - Haufe Group SE
Data Engineer
Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure using Python, SQL, and AWS services to support analytics and machine learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and load data from diverse sources into data lakes and warehouses.
- Implement data models and schemas that support business intelligence, reporting, and advanced analytics.
- Optimize data processing workflows for performance, reliability, and cost-efficiency on AWS (S3, Redshift, Glue, EMR).
- Collaborate with data scientists, analysts, and product teams to understand data requirements and deliver high-quality datasets.
- Monitor pipeline health, troubleshoot issues, and implement automated alerts and recovery mechanisms.
Requirements
- Proven experience with Python, SQL, and data engineering tools (Airflow, dbt, Spark).
- Hands‑on knowledge of AWS data services and cloud architecture.
- Strong understanding of data modeling, normalization, and performance tuning.
- Experience with version control (Git) and CI/CD for data workflows.
- Excellent problem‑solving skills and a collaborative mindset.