remoteonsite
Senior Software -Data Engineer - Azure- Kore AI - CGI
Data Engineer
Senior Data Engineer focused on Azure data platform, building scalable pipelines, data lakes, and analytics solutions using Python, SQL, and Spark.
About the role
Key Responsibilities
- Design, develop, and maintain Azure-based data pipelines and data lake solutions to support enterprise analytics.
- Implement ETL processes using Azure Data Factory, Databricks, and Spark, ensuring data quality and performance.
- Collaborate with data scientists and business stakeholders to translate requirements into scalable data models.
- Optimize data storage and query performance across Azure SQL, Synapse, and Cosmos DB.
- Monitor, troubleshoot, and document data workflows, applying best practices for security and governance.
Requirements
- 5+ years of experience in data engineering with a strong focus on Azure services.
- Proficiency in Python, SQL, and Spark for data transformation and processing.
- Hands‑on experience with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage.
- Solid understanding of data modeling, ETL design patterns, and performance tuning.
- Excellent communication skills and ability to work cross‑functionally in a fast‑paced environment.