onsite
Kafka Engineer - Social Security Administration
Software Engineer
Senior Kafka Engineer responsible for designing, deploying, and maintaining high‑availability Kafka clusters, stream processing pipelines, and related infrastructure using Java, Scala, and Apache Zookeeper.
About the role
Key Responsibilities
- Design, implement, and operate scalable Kafka clusters to support mission‑critical data pipelines.
- Develop and maintain stream processing applications in Java or Scala, ensuring low latency and high throughput.
- Configure and manage Apache Zookeeper ensembles, topic partitions, replication, and security settings.
- Monitor cluster health, troubleshoot performance bottlenecks, and apply capacity planning.
- Collaborate with data engineering and DevOps teams to integrate Kafka with downstream analytics and storage systems.
Requirements
- 5+ years of experience with Apache Kafka and related ecosystem components.
- Experience with monitoring tools (Prometheus, Grafana) and CI/CD pipelines.
- Excellent problem‑solving skills and ability to work in a fast‑paced, mission‑critical environment.