onsite
Data Pipeline Engineer - Hexegic
Software Engineer
Data Pipeline Engineer responsible for maintaining, monitoring, and troubleshooting data pipelines using Python, SQL, Airflow, and AWS to ensure accurate, timely data for analytics platforms.
About the role
Key Responsibilities
- Maintain and optimize Airflow DAGs to ensure reliable, on‑time data pipeline execution.
- Implement and monitor health checks, alerts, and automated triage for data quality and pipeline failures.
- Diagnose and resolve code and configuration issues across Python, SQL, and AWS services.
- Collaborate with data scientists and analysts to understand data requirements and deliver clean, actionable datasets.
- Document pipeline logic, runbooks, and incident response procedures for cross‑team visibility.
Requirements
- 3+ years of experience building and maintaining data pipelines in a production environment.
- Experience with data quality frameworks, monitoring, and alerting.
- Excellent problem‑solving skills and a proactive, hands‑on approach to incident response.
Skills
pythonsqlairflowaws