onsite
Data Engineer - The Walt Disney Company
Data Engineer
Data Engineer responsible for building and maintaining scalable data pipelines, integrating diverse data sources, and enabling analytics for Disney's Decision Science team using Python, SQL, Spark, Airflow, and AWS.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and store data from multiple Disney business units.
- Implement data models and schemas that support analytical and statistical modeling workloads.
- Orchestrate workflow automation using Apache Airflow, ensuring reliable scheduling and monitoring of data jobs.
- Leverage AWS services (e.g., S3, Redshift, Glue, Lambda) to build scalable, cost‑effective data solutions.
- Collaborate with data scientists, analysts, and product owners to translate business requirements into technical specifications.
Requirements
- Strong proficiency in Python and SQL for data manipulation and pipeline development.
- Hands‑on experience with big‑data processing frameworks such as Apache Spark.
- Proven ability to design and operate data pipelines using Airflow or similar orchestration tools.
- Experience with cloud platforms, preferably AWS, including data storage and compute services.
- Solid understanding of data modeling, warehousing concepts, and best practices for data quality and governance.
Skills
pythonsqlapache sparkairflowaws