remote
Senior Data Engineer contract - Microsoft
Data Engineer
Senior Data Engineer leading Azure‑based data platform modernization, driving Unity Catalog migration, redesigning orchestration patterns, and optimizing costs across Databricks and ADF workloads.
About the role
Key Responsibilities
- Own technical design and phased execution plan for Unity Catalog migration across priority data domains.
- Define target orchestration patterns and guide migration of legacy workflows to Azure Data Factory and Databricks.
- Lead cross‑functional teams to deliver migration strategy, ensuring minimal downtime and data integrity.
- Implement cost‑optimization measures across Azure Databricks and ADF workloads, monitoring usage and recommending savings.
- Collaborate with data architects to align modernization efforts with enterprise data governance and security standards.
Requirements
- 5+ years of experience in data engineering with deep expertise in Azure Databricks and Azure Data Factory.
- Proven track record of designing and executing large‑scale data platform migrations, including Unity Catalog implementation.
- Strong understanding of data orchestration, workflow automation, and cost‑management best practices.
- Excellent communication skills and ability to work effectively with cross‑functional teams.
Skills
pythonsqlazureapache sparkdatabrickstableaupower biunity