onsite
Senior Data Engineer - Infinigate
Data Engineer
Senior Data Engineer building scalable data pipelines and analytics solutions on Databricks and Microsoft Fabric, leveraging Python, Spark, and Azure to deliver AI‑driven insights for a fast‑paced, innovative environment.
About the role
Key Responsibilities
- Design, develop, and maintain end‑to‑end data pipelines using Databricks and Microsoft Fabric.
- Implement scalable data models and optimize SQL queries for performance and reliability.
- Collaborate with data scientists and product teams to support AI and analytics initiatives.
- Ensure data quality, governance, and security across the data platform.
- Monitor, troubleshoot, and continuously improve pipeline efficiency and cost.
Requirements
- 5+ years of experience in data engineering with strong Python and Spark skills.
- Proven expertise in Databricks, Microsoft Fabric, and Azure data services.
- Deep knowledge of SQL, data modeling, and ETL best practices.
- Experience with CI/CD, version control, and automated testing for data workflows.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythondatabrickssqlapache sparkazure