remoteonsite
Platform Services Lead - IWPB Data Technology - HSBC
Software Engineer
Lead the design, delivery and operation of data platform services for Institutional Wealth & Personal Banking, driving cloud‑native solutions with Java, Python, Spark, Kafka and Kubernetes on AWS.
About the role
Key Responsibilities
- Architect, build and maintain scalable data platform services supporting real‑time and batch processing for IWPB business lines.
- Lead a cross‑functional team in the implementation of cloud‑native solutions using AWS, Kubernetes, and container orchestration.
- Design and optimise data pipelines with Apache Spark and Kafka, ensuring high performance, reliability and security.
- Collaborate with product owners, data engineers and architects to translate business requirements into technical specifications.
- Establish best practices for CI/CD, monitoring, and incident management across the data platform stack.
Requirements
- 5+ years of experience in data engineering or platform engineering, with a strong focus on Java and Python development.
- Proven expertise in building and operating big‑data solutions using Apache Spark, Kafka and related technologies.
- Hands‑on experience with cloud services (AWS) and container orchestration (Kubernetes, Docker).
- Solid understanding of DevOps practices, CI/CD pipelines, and infrastructure‑as‑code tools.
- Excellent communication and leadership skills, with a track record of guiding technical teams in a fast‑paced financial services environment.
Skills
javapythonapache sparkkafkakubernetesaws