remote
Data Engineer MS Fabric / Databricks - Consultant - Deloitte
Data Engineer
Consultant data engineer focused on building scalable data pipelines using MS Fabric and Databricks, leveraging Spark, SQL, Python, and Azure services to deliver enterprise analytics solutions.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines in MS Fabric and Databricks environments.
- Implement Spark jobs and SQL transformations to ingest, cleanse, and enrich large datasets.
- Collaborate with data scientists and business stakeholders to translate analytical requirements into scalable data solutions.
- Optimize performance and cost of data workloads on Azure, ensuring high availability and reliability.
- Document architecture, code, and best practices for future maintenance and knowledge transfer.
Requirements
- 3+ years of experience in data engineering with MS Fabric and Databricks.
- Experience with data modeling, ETL design, and performance tuning.
- Excellent communication skills and ability to work collaboratively in a hybrid setting.
Skills
databricksapache sparksqlpythonazure