remote
Senior Databricks Platform Engineer - Azure Cloud & Data Operations - Kutir Technologies
Devops Engineer
Lead the design, deployment, and automation of enterprise‑grade Databricks platforms on Azure, driving data‑intensive workloads, DevOps enablement, and modern cloud infrastructure for large‑scale modernization initiatives.
About the role
Key Responsibilities
- Architect, build, and operate scalable Databricks environments on Azure to support high‑performance, calculation‑heavy data pipelines.
- Implement infrastructure‑as‑code using Terraform and automate provisioning of cloud resources, networking, and security controls.
- Design and maintain CI/CD pipelines for data workloads, integrating testing, versioning, and release management.
- Collaborate with data engineering, analytics, and DevOps teams to define best practices for data platform reliability, performance, and cost optimization.
- Provide technical leadership and mentorship, guiding junior engineers in cloud native patterns, Spark optimization, and operational monitoring.
Requirements
- 5+ years of experience building and managing Databricks platforms on Azure, with deep knowledge of Apache Spark.
- Strong proficiency in Terraform or similar IaC tools and hands‑on experience with Azure services (AKS, Data Lake, Synapse, etc.).
- Demonstrated expertise in CI/CD concepts, scripting (Python, Bash) and container orchestration with Kubernetes.
- Solid understanding of DevOps principles, monitoring, logging, and security in cloud environments.
- Excellent problem‑solving skills and ability to work autonomously in a fully remote setting.
Skills
databricksazureapache sparkterraformcicdkubernetespython