remote
Platform Engineer - Manager - Kubrick Group
Devops Engineer
Lead platform engineering initiatives, building scalable data platforms on Databricks across Azure, AWS, and GCP, leveraging IaC and modern DevOps practices to orchestrate data ingestion and transfer workflows.
About the role
Key Responsibilities
- Design, build, and maintain end‑to‑end data platforms on Databricks across Azure, AWS, and GCP.
- Implement Infrastructure as Code solutions using Terraform, Pulumi, or similar tools to provision cloud resources.
- Integrate and orchestrate data ingestion frameworks (e.g., Kafka, Airflow, Azure Data Factory) to move data from source systems to target platforms.
- Collaborate with data scientists, analysts, and stakeholders to define platform requirements and ensure high availability, security, and performance.
- Drive continuous improvement of CI/CD pipelines, monitoring, and observability for platform reliability.
Requirements
- 5+ years of experience in platform engineering or data engineering roles.
- Proven expertise with Databricks and cloud platforms (Azure, AWS, GCP).
- Strong background in Infrastructure as Code and DevOps practices.
- Hands‑on experience with data ingestion and orchestration tools.
- Excellent communication skills and ability to lead cross‑functional teams.
Skills
databricksazureawsgcp