onsite
Senior Databricks Engineer - Bounteous
Software Engineer
Lead end‑to‑end data engineering on Databricks, designing scalable Spark pipelines, optimizing Delta Lake storage, and integrating MLflow for model lifecycle management. Drive performance, reliability, and best practices across cloud data platforms.
About the role
Key Responsibilities
- Architect, develop, and maintain large‑scale Spark pipelines on Databricks, ensuring high performance and reliability.
- Design and implement Delta Lake solutions for ACID transactions, schema evolution, and data versioning.
- Collaborate with data scientists to integrate MLflow for experiment tracking, model registry, and deployment pipelines.
- Optimize data workflows, troubleshoot performance bottlenecks, and enforce coding standards and best practices.
- Mentor junior engineers, conduct code reviews, and promote knowledge sharing across the data team.
Requirements
- 5+ years of experience in data engineering with a focus on Spark and Databricks.
Skills
databricksapache sparkscalapython