onsite
Senior Data Engineer - Azure Data Factory & Databricks - HCLTech
Data Engineer
Senior Data Engineer responsible for designing, building, and optimizing scalable data pipelines on Azure Data Factory, Databricks, and Snowflake, while ensuring performance, security, and alignment with business requirements.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines using Azure Data Factory, Databricks, and Snowflake.
- Collaborate with business stakeholders to gather requirements and translate them into technical specifications.
- Optimize and tune data workflows for high performance, reliability, and cost efficiency.
- Implement data security, governance, and compliance controls throughout the data lifecycle.
- Conduct code reviews, unit testing, and deployment automation to ensure quality releases.
Requirements
- 5+ years of hands‑on experience in data engineering, with deep expertise in Azure Data Factory and Databricks.
- Strong proficiency in Snowflake data warehousing and SQL query optimization.
- Solid programming skills in Python (or Scala) for data transformation and orchestration.
- Experience with data modeling, ETL/ELT design, and performance tuning of large‑scale data pipelines.
- Understanding of data security best practices and cloud‑based governance frameworks.
Skills
databrickssnowflakesqlpython