remoteonsite
Staff Software Engineer - Data & Audience Platform - Warner Bros. Discovery
Software Engineer
Lead the design and delivery of scalable data platforms for audience insights, building real‑time pipelines and analytics services using Python, Java, Spark, AWS, Kafka and SQL.
About the role
Key Responsibilities
- Architect, develop, and maintain high‑performance data pipelines that ingest, process, and store audience interaction data at scale.
- Design and implement real‑time streaming solutions using Kafka and Spark Structured Streaming.
- Collaborate with product, analytics, and engineering teams to define data models, APIs, and services that enable audience segmentation and personalization.
- Drive adoption of cloud-native best practices on AWS, including serverless compute, data lake formation, and CI/CD automation.
- Mentor senior engineers, conduct code reviews, and champion engineering standards for reliability, security, and performance.
Requirements
- 10+ years of software engineering experience, with at least 5 years focused on large‑scale data platforms.
- Strong proficiency in Python and Java, and deep experience with Apache Spark (batch and streaming).
- Hands‑on expertise with AWS services such as S3, EMR, Lambda, and Glue, and infrastructure‑as‑code tools.
- Solid understanding of event‑driven architectures using Kafka, and strong SQL skills for data modeling and analytics.
- Proven track record of leading technical teams, delivering production‑grade services, and mentoring engineers.
Skills
pythonjavaapache sparkawskafkasql