onsite
Data Automation Specialist - Harper
Software Engineer
Lead end‑to‑end data automation, building scalable pipelines in Python and Airflow on AWS to transform raw data into actionable insights for a high‑growth insurance tech company.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines using Python, SQL, and Airflow to ingest, transform, and load data across multiple sources.
- Collaborate with data scientists and product teams to understand data requirements and deliver clean, high‑quality datasets.
- Implement automated testing, monitoring, and alerting to ensure pipeline reliability and performance.
- Optimize existing workflows for scalability, cost, and speed on AWS infrastructure.
- Document data models, pipeline logic, and best practices for internal knowledge sharing.
Requirements
- 3+ years of experience in data engineering or data automation roles.
- Hands‑on experience deploying and managing pipelines on AWS (S3, Redshift, Glue, Lambda).
- Strong problem‑solving skills and ability to work in a fast‑paced, high‑standard environment.
- Excellent communication skills and a collaborative mindset.
Skills
pythonsqlairflowaws