onsite
DevOps Engineer - Solulever
Devops Engineer
DevOps Engineer focused on building and scaling data and machine‑learning infrastructure, automating pipelines, and managing cloud resources for high‑throughput analytics platforms.
About the role
Key Responsibilities
- Design, deploy, and maintain scalable cloud infrastructure for big‑data and machine‑learning workloads.
- Automate and optimise end‑to‑end data pipelines using tools such as Apache Spark, Airflow, and custom Python scripts.
- Implement CI/CD pipelines, container orchestration, and IaC practices with Docker, Kubernetes, and Terraform.
- Monitor system performance, ensure high availability, and troubleshoot production issues across the platform.
- Collaborate with data scientists and engineering teams to provide reliable, secure environments that accelerate model development and deployment.
Requirements
- 3+ years of hands‑on experience in DevOps or Site Reliability Engineering, preferably in data‑intensive environments.
- Proficiency with cloud platforms (AWS) and infrastructure‑as‑code tools (Terraform, CloudFormation).
- Strong knowledge of containerization (Docker) and orchestration (Kubernetes) for production workloads.
- Experience building and maintaining data pipelines using Apache Spark, Airflow, or similar technologies.
- Solid scripting skills in Python (or Bash) and familiarity with CI/CD tools such as Jenkins, GitLab CI, or GitHub Actions.
Skills
awsdockerkubernetesterraformapache sparkpython