onsite
Cloud Data Engineer - VGH Versicherungen
Data Engineer
Lead cloud data engineering projects on AWS and Databricks, designing scalable pipelines, optimizing Spark jobs, and ensuring data quality for enterprise analytics.
About the role
Key Responsibilities
- Design, develop, and maintain data pipelines on AWS using Databricks and Spark.
- Implement ETL processes, data transformations, and data quality checks in Python and SQL.
- Collaborate with data scientists and business stakeholders to deliver actionable insights.
- Optimize performance and cost of cloud data workloads.
- Document architecture, code, and best practices for the data engineering team.
Requirements
- Proven experience with AWS services (S3, Glue, Redshift, EMR) and Databricks.
- Strong programming skills in Python and SQL; familiarity with Spark.
- Hands‑on experience building and maintaining ETL pipelines.
- Solid understanding of data modeling, data warehousing, and data lake concepts.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
awsdatabrickssqlpython