onsite
Senior Data Engineer - v2 Digital
Data Engineer
Lead the design and development of scalable data pipelines and lakehouse platforms using Databricks, Spark, and Python to enable AI-driven insights for enterprise clients.
About the role
Key Responsibilities
- Architect and implement end‑to‑end data pipelines on Databricks, ensuring high performance and reliability.
- Design lakehouse data models that support both batch and streaming workloads for AI and analytics use cases.
- Collaborate with data scientists and product teams to translate business requirements into scalable data solutions.
- Optimize Spark jobs, manage cluster resources, and enforce best practices for data quality and governance.
- Mentor junior engineers and drive continuous improvement of data engineering processes.
Requirements
- 5+ years of experience in data engineering with a focus on cloud data platforms.
- Proficiency in Databricks, Apache Spark, and Python for data processing.
- Strong SQL skills and experience with data modeling in a lakehouse context.
- Hands‑on experience with data quality, lineage, and security controls.
- Excellent communication skills and a collaborative mindset.
Skills
databricksapache sparkpythonsql