remote
Data Engineer, Ads Product & Tech - Spotify
Data Engineer
Build and maintain scalable data pipelines and reporting systems for a high‑volume advertising platform, leveraging Python, SQL, Airflow, Spark, and cloud services to deliver reliable, real‑time insights.
About the role
Key Responsibilities
- Design, develop, and operate robust ETL pipelines that ingest, transform, and store advertising data at petabyte scale.
- Collaborate with product, analytics, and engineering teams to define data models and reporting requirements for personalized ad delivery.
- Implement data quality, monitoring, and alerting frameworks using Airflow and cloud-native tools.
- Optimize query performance and cost efficiency in BigQuery and Spark environments.
- Maintain and evolve the data infrastructure on AWS, ensuring high availability and security.
Requirements
- 5+ years of professional experience building data pipelines and backend systems for large‑scale platforms.
- Strong proficiency in Python and SQL, with hands‑on experience in Apache Airflow, Spark, and Google BigQuery.
- Solid understanding of cloud platforms (AWS) and data storage solutions.
- Experience with data modeling, schema design, and performance tuning for analytics workloads.
- Ability to work cross‑functionally, communicate technical concepts clearly, and drive projects from concept to production.
Skills
pythonsqlapache sparkaws