remote
Azure Data Engineer - Exceliq Consulting (India) Pvt. Ltd.
Data Engineer
Senior Azure Data Engineer with 5+ years designing, building, and optimizing scalable ETL/ELT pipelines on Azure, leveraging ADF, ADLS, and MS SQL Server to deliver high‑performance, enterprise‑scale data integration solutions.
About the role
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, ensuring reliability and performance at enterprise scale.
- Build and manage incremental data ingestion workflows into Azure Data Lake Storage, optimizing data lake architecture for cost and performance.
- Implement data modeling best practices in MS SQL Server, creating efficient schemas and indexing strategies to support analytics workloads.
- Collaborate with data scientists and business analysts to translate business requirements into robust data solutions.
- Monitor, troubleshoot, and tune pipeline performance, applying best practices for error handling, logging, and alerting.
- Document architecture, data flows, and operational procedures to enable knowledge transfer and maintainability.
Requirements
- 5+ years of hands‑on experience as an Azure Data Engineer or similar role.
- Proficiency with Azure Data Factory, Azure Data Lake Storage, and MS SQL Server.
- Strong background in data modeling, ETL/ELT design, and performance optimization.
- Experience with Azure DevOps or similar CI/CD pipelines for data workflows.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.
Skills
sqlazuredatabrickssnowflakepower biagile