onsite
Data Engineer Consultant - CDW
Data Engineer
Consulting Data Engineer who designs, builds, and maintains scalable data pipelines on Azure and Microsoft Fabric, enabling enterprise analytics through robust ETL processes, data modeling, and performance optimization.
About the role
Key Responsibilities
- Design and implement end‑to‑end data pipelines using Azure Data Factory, Synapse, and Microsoft Fabric.
- Develop, test, and maintain ETL/ELT processes in Python and SQL to ingest, transform, and load data from diverse sources.
- Collaborate with analytics and business teams to model data structures that support reporting and advanced analytics.
- Monitor pipeline performance, troubleshoot issues, and apply optimizations for reliability and scalability.
- Implement data governance, security, and compliance best practices within the Azure ecosystem.
Requirements
- 3+ years of hands‑on experience building data pipelines on Azure (Data Factory, Synapse, Databricks) and Microsoft Fabric.
- Proficiency in SQL and Python for data transformation and scripting.
- Strong understanding of data modeling, warehousing concepts, and ETL/ELT design patterns.
- Experience with cloud‑native data storage solutions (Azure Data Lake, Blob Storage) and CI/CD pipelines.
- Excellent problem‑solving skills and ability to work collaboratively with cross‑functional teams.