remote
Sr. Data Engineer - Reston, VA - Freewheel - Comcast
Data Engineer
Senior Data Engineer focused on building and optimizing large-scale data pipelines using Python, Spark, and Airflow on AWS, ensuring data quality, modeling, and mentoring junior team members in a fast-paced ad tech environment.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and advanced data structures for ad platform analytics.
- Optimize data flows across multiple storage solutions, ensuring high performance and reliability.
- Mentor junior engineers, providing guidance on best practices in data engineering and code quality.
- Collaborate with cross-functional teams to build internal tools that support data ingestion, transformation, and reporting.
- Implement robust data quality checks, monitoring, and alerting to maintain data integrity.
Requirements
- 5+ years of experience in data engineering with strong proficiency in Python and SQL.
- Hands‑on experience with Apache Spark, Airflow, and AWS services (S3, Redshift, Glue).
- Deep understanding of data modeling, ETL processes, and data lake architecture.
- Excellent problem‑solving skills and ability to work independently in a dynamic environment.
- Strong communication skills and a collaborative mindset.
Skills
pythonsqlapache sparkairflowaws