onsite
Senior Software Engineer - Customer Data Platform
Software Engineer
Lead the design and implementation of high‑throughput data pipelines and RESTful APIs on AWS, leveraging Flink, Kafka, and Spark to power a scalable customer data platform.
About the role
Key Responsibilities
- Architect, develop, and maintain scalable data ingestion and processing pipelines using Apache Flink, Kafka, and Spark on AWS.
- Design and expose robust RESTful APIs to serve real‑time customer data to downstream services.
- Collaborate with data scientists and product teams to translate business requirements into technical solutions.
- Optimize performance, reliability, and cost of data workflows through monitoring, tuning, and automation.
- Mentor junior engineers and conduct code reviews to uphold high coding standards.
Requirements
- 5+ years of software engineering experience with a focus on data platforms.
- Proficiency in AWS services (Kinesis, Lambda, S3, EMR) and experience deploying Flink, Kafka, and Spark clusters.
- Strong background in API design and implementation (REST, gRPC).
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
- Experience with CI/CD pipelines, containerization (Docker, Kubernetes) and automated testing is a plus.
Skills
awsapache flinkapache spark