remote
Senior Data Engineer - The Walt Disney Company
Data Engineer
Senior Data Engineer building scalable data pipelines and analytics solutions on AWS, leveraging Python, SQL, and Spark to support Disney’s global media data infrastructure.
About the role
Key Responsibilities
- Design, develop, and maintain large-scale data pipelines using Python, SQL, and Apache Spark on AWS.
- Implement robust ETL processes to ingest, transform, and load data from diverse sources into data lakes and warehouses.
- Collaborate with data scientists and product teams to deliver high‑quality, production‑ready datasets for analytics and storytelling.
- Optimize query performance and storage costs through data modeling, partitioning, and caching strategies.
- Ensure data quality, governance, and security compliance across all data assets.
Requirements
- 5+ years of experience in data engineering, with a strong background in Python and SQL.
- Hands‑on experience with Apache Spark, AWS services (S3, Redshift, Glue, Athena), and data lake architecture.
- Proven ability to design scalable, fault‑tolerant ETL pipelines and perform performance tuning.
- Strong understanding of data modeling, schema design, and data governance best practices.
- Excellent communication skills and a collaborative mindset to work across cross‑functional teams.
Skills
pythonsqlapache sparkaws