onsite
Senior Software Engineer - Ads Data Platform
Software Engineer
Lead the design and implementation of high‑throughput, real‑time data pipelines for advertising analytics on AWS, leveraging Flink, Kafka, and Spark to deliver scalable, low‑latency APIs.
About the role
Key Responsibilities
- Architect, develop, and maintain large‑scale data ingestion and processing pipelines using Apache Flink, Kafka, and Spark on AWS.
- Design and expose robust RESTful APIs that serve real‑time ad performance metrics to internal and external stakeholders.
- Collaborate with data scientists and product managers to translate business requirements into scalable, fault‑tolerant data solutions.
- Optimize pipeline performance, monitor system health, and implement automated alerting and recovery mechanisms.
- Mentor junior engineers, conduct code reviews, and promote best practices in cloud architecture and data engineering.
Requirements
- 5+ years of experience in data engineering or backend development with a focus on real‑time processing.
- Proficiency in AWS services (Kinesis, S3, EMR, Lambda) and experience deploying Flink/Spark jobs in the cloud.
- Strong background in Java/Scala and API design patterns.
- Hands‑on experience with Kafka for event streaming and message brokering.
- Excellent problem‑solving skills, ability to work independently, and a passion for building high‑performance data systems.
Skills
awsapache flinkapache spark