onsite
Senior Consultant Data Engineering / Azure / GCP - Deloitte GmbH
Software Engineer
Lead complex data engineering projects on Azure and GCP, designing scalable pipelines, data lakes, and analytics solutions using Python, SQL, and Spark.
About the role
Key Responsibilities
- Architect and implement end‑to‑end data pipelines on Azure Data Factory, Databricks, and GCP Dataflow.
- Design and maintain scalable data lake and warehouse solutions using Azure Synapse, BigQuery, and Delta Lake.
- Collaborate with data scientists and business stakeholders to translate requirements into robust data models and ETL processes.
- Optimize performance and cost of cloud data services, applying best practices for security, governance, and compliance.
- Mentor junior engineers and conduct knowledge‑sharing sessions on cloud data technologies.
Requirements
- 5+ years of professional experience in data engineering with a strong focus on cloud platforms.
- Proficient in Python, SQL, and distributed processing frameworks such as Apache Spark.
- Hands‑on experience with Azure Data Factory, Databricks, Azure Synapse, GCP Dataflow, and BigQuery.
- Solid understanding of data lake architecture, data warehousing, and data governance principles.
- Excellent communication skills and a proven ability to work in cross‑functional teams.
Skills
azurepythonsqlapache spark