remote
Lead Databricks Administrator - Epsilon
Software Engineer
Lead the design, implementation, and performance tuning of cloud‑based Data Lake environments using Databricks across AWS, Azure, and GCP, while guiding a team of administrators and ensuring reliable, scalable data pipelines.
About the role
Key Responsibilities
- Architect, deploy, and manage enterprise‑scale Databricks workspaces on AWS, Azure, and Google Cloud.
- Design and optimize data lake schemas, ensuring high performance for large‑volume analytics workloads.
- Lead a team of administrators, providing mentorship, best‑practice guidance, and incident response.
- Implement security, governance, and cost‑optimization policies across multi‑cloud environments.
- Collaborate with data engineering and analytics teams to streamline ETL pipelines and troubleshoot performance issues.
Requirements
- 5+ years of hands‑on experience administering Databricks in production, preferably across multiple cloud platforms.
- Strong expertise in AWS, Azure, and Google Cloud services related to data storage and processing.
- Deep knowledge of SQL, data lake design, and performance tuning techniques.
- Proven leadership experience managing technical teams and driving operational excellence.
- Excellent problem‑solving skills and ability to work in a fast‑paced, cross‑functional environment.
Skills
databricksawsazuresql