onsite
Senior Data Engineer - Hasbro
Data Engineer
Senior Data Engineer responsible for designing, building, and scaling data pipelines on cloud platforms, leveraging Python, SQL, Spark, and streaming technologies to enable analytics and machine‑learning initiatives.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL/ELT pipelines using Python, SQL, and Apache Spark to ingest and transform large‑scale data sets.
- Implement and manage workflow orchestration with Apache Airflow, ensuring reliable scheduling, monitoring, and error handling.
- Build real‑time data streaming solutions with Kafka to support low‑latency analytics and downstream applications.
- Deploy and optimize data infrastructure on AWS services (S3, Redshift, EMR, Glue) for scalability, security, and cost efficiency.
- Collaborate with data scientists, analysts, and product teams to understand requirements and deliver data solutions that drive business insights.
Requirements
- 5+ years of professional experience in data engineering or related fields.
- Strong proficiency in Python and SQL, with hands‑on experience building Spark jobs.
- Deep understanding of cloud platforms, preferably AWS, and associated data services.
- Experience with workflow orchestration tools such as Apache Airflow and streaming platforms like Kafka.
- Solid grasp of data modeling, schema design, and best practices for data quality and governance.
Skills
pythonsqlapache sparkawsairflowkafka