remoteonsite
Manager, Databricks Engineering - Deloitte
Software Engineer
Lead a high‑impact Databricks engineering team, architecting scalable data pipelines and analytics solutions on cloud platforms to empower data‑driven decision making.
About the role
Key Responsibilities
- Lead the design, development, and deployment of end‑to‑end data pipelines using Databricks and Apache Spark on AWS or GCP.
- Architect scalable, secure, and high‑performance data solutions that transform raw data into actionable insights.
- Mentor and grow a multidisciplinary engineering team, fostering best practices in coding, testing, and documentation.
- Collaborate with data scientists, product owners, and stakeholders to translate business requirements into technical specifications.
- Ensure compliance with data governance, security, and regulatory standards across all data assets.
Requirements
- 5+ years of experience in data engineering, with 2+ years in a managerial or lead role.
- Proficiency in Databricks, Apache Spark, Python, and SQL; experience with cloud data platforms (AWS, GCP).
- Strong understanding of data architecture, ETL/ELT processes, and data lakehouse concepts.
- Excellent communication skills and ability to translate complex technical concepts to non‑technical stakeholders.
- Experience with CI/CD, version control, and automated testing in data environments is a plus.
Skills
databricksapache sparkpythonsql