onsite
ETL / Data Engineer - committance AG
Data Engineer
Lead the design and maintenance of scalable ETL pipelines, transforming raw data into actionable insights using Python, SQL, and cloud services such as AWS. Drive data quality, automation, and performance across the organization.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines that ingest, transform, and load data from diverse sources into data warehouses.
- Optimize data workflows using Python, SQL, Apache Spark, and Airflow to ensure high performance and reliability.
- Implement data quality checks, monitoring, and alerting to guarantee data integrity and availability.
- Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver actionable data solutions.
- Leverage AWS services (S3, Redshift, Glue, Lambda) to build scalable, cost‑efficient data architectures.
Requirements
- 3+ years of experience in data engineering or related roles.
- Hands‑on experience with Spark, Airflow, and containerization (Docker).
- Excellent problem‑solving skills and a proactive, collaborative mindset.
Skills
pythonsqlawsapache sparkairflow