onsite
Senior Data Lead - Azure Data Factory & Databricks - HCLTech
Software Engineer
Lead cross‑functional data engineering teams to design, build, and optimize scalable pipelines on Azure Data Factory, Databricks, and Snowflake, ensuring high‑performance data solutions that drive business insights.
About the role
Key Responsibilities
- Lead and mentor technical teams in the design, development, and deployment of data pipelines using Azure Data Factory, Databricks, and Snowflake.
- Architect end‑to‑end data workflows that meet business requirements, focusing on performance, reliability, and maintainability.
- Collaborate with stakeholders to translate business needs into technical specifications and data models.
- Implement best practices for data governance, security, and compliance across all data platforms.
- Continuously evaluate and adopt new Azure and Databricks features to improve pipeline efficiency and cost effectiveness.
Requirements
- 5+ years of experience in data engineering with a strong focus on Azure Data Factory, Databricks, and Snowflake.
- Proficient in SQL, Python, and data modeling techniques.
- Hands‑on experience building and optimizing large‑scale data pipelines and ETL processes.
- Excellent communication skills and ability to work cross‑functionally with business and technical stakeholders.
- Experience with data governance, security, and compliance frameworks is a plus.
Skills
databrickssnowflakesql