remote
Data Engineer - Instil Software
Data Engineer
Data Engineer building and maintaining cloud‑based data pipelines, ensuring high quality and reliability for analytics and downstream applications using Python, SQL, AWS, Airflow, and advanced data modeling techniques.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on AWS, ensuring data quality, reliability, and performance.
- Collaborate with cross‑functional teams to model data for analytics, reporting, and downstream use cases.
- Implement and monitor Airflow workflows, automate data ingestion, transformation, and loading processes.
- Optimize existing ETL processes, troubleshoot issues, and continuously improve pipeline efficiency.
- Document data architecture, pipeline logic, and best practices for future reference.
Requirements
- 2–5 years of commercial experience in data engineering or data‑focused software engineering.
- Proficiency in Python, SQL, and AWS services (S3, Redshift, Glue, Lambda).
- Hands‑on experience with Airflow or similar workflow orchestration tools.
- Strong understanding of data modeling, ETL design, and data quality principles.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced environment.
Skills
pythonsqlawsairflow