onsite
Databricks Data Engineering Manager
Engineering Manager
Lead a high‑performing data engineering team focused on building scalable Databricks pipelines, ensuring robust data architecture, governance, and BI solutions that drive enterprise insights.
About the role
Key Responsibilities
- Architect, develop, and maintain end‑to‑end data pipelines on Databricks, ensuring performance, reliability, and scalability.
- Define and enforce data governance policies, data quality standards, and security best practices across the data platform.
- Collaborate with data scientists, analysts, and business stakeholders to translate business requirements into technical solutions and actionable BI dashboards.
- Mentor and grow a team of data engineers, fostering a culture of continuous improvement, code quality, and knowledge sharing.
- Drive adoption of modern data tools and practices, including Delta Lake, MLflow, and automated testing frameworks.
Requirements
- 5+ years of experience in data engineering with a strong focus on Databricks and Spark.
- Proven track record managing and scaling data teams in a fast‑moving environment.
- Deep expertise in data architecture, ETL design, and data governance frameworks.
- Strong programming skills in Python and SQL, with familiarity in Scala or Java preferred.
- Excellent communication skills and ability to translate complex technical concepts to non‑technical stakeholders.
Skills
databrickssqlpython