remote
Lead Data Engineer - Azure & Databricks - UST
Data Engineer
Lead the design and delivery of enterprise‑scale data platforms on Azure and Databricks, building scalable pipelines, mentoring teams, and collaborating with architects and data scientists to enable advanced analytics and secure, high‑performance data solutions.
About the role
Key Responsibilities
- Architect and implement end‑to‑end data pipelines using Azure Data Factory, Databricks, and Spark, ensuring scalability and performance.
- Design and maintain data lake and warehouse solutions, applying best practices in data modeling, partitioning, and governance.
- Lead a high‑performing engineering team, providing mentorship, code reviews, and fostering a culture of continuous improvement.
- Collaborate with data scientists, architects, and business stakeholders to translate analytical requirements into robust data solutions.
- Ensure data security, compliance, and quality through rigorous testing, monitoring, and documentation.
Requirements
- 5+ years of experience in data engineering with a strong focus on Azure and Databricks.
- Hands‑on experience with Azure Data Lake, Synapse Analytics, and related services.
- Strong understanding of data governance, security, and compliance frameworks.
- Excellent communication skills and proven ability to lead technical teams.