onsite
Data Engineer - Claranet
Data Engineer
Data Engineer skilled in building and maintaining scalable data pipelines on Azure, leveraging SQL, Python/Scala, Databricks, and Azure Data Factory, with strong data modelling and CI/CD automation experience.
About the role
Key Responsibilities
- Design, develop, and operate end‑to‑end data pipelines on Azure using Databricks and Azure Data Factory.
- Implement robust data models for both relational and analytical workloads, ensuring data quality and performance.
- Write production‑grade code in Python and/or Scala to transform and enrich large datasets.
- Automate deployment and testing of data solutions with CI/CD pipelines and version control.
- Collaborate with data analysts, scientists, and business stakeholders to translate requirements into scalable data solutions.
Requirements
- Strong proficiency in SQL and experience with relational and analytical data modelling.
- Hands‑on programming experience in Python and/or Scala.
- Deep knowledge of Azure data services, including Azure Data Factory and Databricks.
- Proven experience building, monitoring, and optimizing data pipelines in a cloud environment.
- Familiarity with CI/CD tools and practices for data engineering workflows.
Skills
sqlpythonscalaazuredatabrickscicd