remote
Kafka Platform Engineer - BV Teck
Devops Engineer
Lead the design, deployment, and maintenance of high‑availability Kafka clusters, integrating streaming pipelines with Java/Scala services on Docker/Kubernetes in AWS environments.
About the role
Key Responsibilities
- Architect, deploy, and scale Kafka clusters for production workloads, ensuring high availability and fault tolerance.
- Develop and maintain streaming pipelines in Java/Scala, integrating with Spark and other data services.
- Implement CI/CD pipelines for Kafka configurations and stream applications using Docker and Kubernetes.
- Monitor cluster health, tune performance, and troubleshoot issues across the data platform.
- Collaborate with data engineering and DevOps teams to optimize data flow and security.
Requirements
- 5+ years of experience with Apache Kafka and related ecosystem components.
- Strong proficiency in Java and Scala for stream processing.
- Hands‑on experience with Docker, Kubernetes, and AWS services (EKS, S3, CloudWatch).
- Solid understanding of CI/CD practices and monitoring tools.
- Excellent problem‑solving skills and ability to work in a fast‑paced environment.
Skills
kafkajavascalaapache sparkdockerkubernetesaws