remoteonsite
Software Engineer, Data Engineering - Fubo
Software Engineer
Lead end‑to‑end data pipeline development using Python, SQL, and Spark on AWS, designing scalable ETL workflows and data models to support real‑time analytics and product features.
About the role
Key Responsibilities
- Design, build, and maintain large‑scale data pipelines using Python, SQL, and Apache Spark on AWS.
- Develop and orchestrate Airflow DAGs to automate data ingestion, transformation, and loading processes.
- Collaborate with data scientists and product teams to define data models and ensure data quality for analytics and reporting.
- Optimize pipeline performance, troubleshoot issues, and implement monitoring and alerting solutions.
- Document architecture, code, and best practices for future maintainability.
Requirements
- 3+ years of experience in data engineering or related field.
- Hands‑on experience with Airflow or similar workflow orchestration tools.
- Excellent problem‑solving skills and ability to work collaboratively in a fast‑paced environment.
Skills
pythonsqlawsapache sparkairflow