remoteonsite
Senior Azure Data Engineer - CGI
Data Engineer
Lead end‑to‑end data platform development on Azure, designing scalable pipelines, data lakes, and analytics solutions using SQL, Python, Spark, and Azure services.
About the role
Key Responsibilities
- Design, build, and maintain scalable data pipelines and lakehouse architectures on Azure using Azure Data Factory, Azure Synapse, and Databricks.
- Develop and optimize SQL and Spark jobs for batch and real‑time data processing, ensuring high performance and reliability.
- Collaborate with data scientists, BI developers, and business stakeholders to translate requirements into robust data models and analytics solutions.
- Implement data governance, security, and compliance controls across the data platform.
- Monitor, troubleshoot, and continuously improve pipeline performance and cost efficiency.
Requirements
- 5+ years of experience in data engineering with a strong focus on Azure services.
- Hands‑on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks.
- Solid understanding of data modeling, ETL/ELT best practices, and data governance principles.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
azuresqlpythonapache spark