onsite
Data Engineering Associate
Software Engineer
Join a dynamic team as a Data Engineering Associate, building scalable Azure-based data pipelines with CI/CD practices and ELT workflows to deliver actionable insights from large datasets.
About the role
Key Responsibilities
- Design, develop, and maintain Azure data pipelines using Data Factory, Databricks, and Synapse Analytics.
- Implement CI/CD workflows for data solutions with Azure DevOps or GitHub Actions, ensuring automated testing and deployment.
- Transform raw data into structured formats via ELT processes, optimizing for performance and cost.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
- Monitor pipeline health, troubleshoot issues, and continuously improve data quality and reliability.
Requirements
- Experience with Azure data services (Data Factory, Databricks, Synapse).
- Proficiency in SQL and data modeling for large-scale datasets.
- Hands‑on knowledge of CI/CD principles and tools for data engineering.
- Strong problem‑solving skills and ability to work in a fast‑paced environment.