remoteonsite
Senior Middleware Messaging Infrastructure Engineer - Kafka - LPL Financial Global Capability Center
Devops Engineer
Senior engineer responsible for designing, implementing, and operating high‑throughput Kafka‑based messaging platforms, ensuring reliability, scalability, and performance for critical middleware services.
About the role
Key Responsibilities
- Design, develop, and maintain Kafka clusters and related middleware components to support high‑volume, low‑latency data pipelines.
- Implement monitoring, alerting, and capacity‑planning strategies to guarantee 99.9% availability and optimal performance.
- Collaborate with application, DevOps, and security teams to integrate Kafka with microservices, APIs, and data platforms.
- Automate provisioning, configuration, and deployment of messaging infrastructure using Docker, CI/CD pipelines, and cloud services (AWS).
- Conduct root‑cause analysis of incidents, perform tuning, and drive continuous improvement of the messaging stack.
Requirements
- 5–7 years of hands‑on experience with Apache Kafka in production environments.
- Strong programming skills in Java (or comparable JVM language) and scripting on Linux.
- Proficiency with containerization (Docker) and orchestration tools, and experience deploying services on AWS.
- Solid understanding of networking, security, and performance tuning for distributed systems.
- Experience with CI/CD frameworks (Jenkins, GitLab CI, etc.) and infrastructure‑as‑code practices.
Skills
kafkajavalinuxdockerawscicd