remote
Python Engineer / Pipeline Developer
Software Engineer
Python Engineer focused on building and maintaining intelligent data orchestration pipelines using Airflow, AWS, and Docker to transform unstructured data into clean, database-ready assets.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines in Python, leveraging Airflow for orchestration.
- Integrate diverse data sources (emails, raw files, client streams) into structured, query‑ready formats.
- Implement robust ETL processes, ensuring data quality, error handling, and performance optimization.
- Collaborate with cross‑functional teams to translate evolving client requirements into technical solutions.
- Deploy and monitor pipeline components on AWS, using services such as S3, Lambda, and RDS.
- Containerize services with Docker and manage CI/CD workflows for rapid iteration.
Requirements
- Proven experience in Python development and data pipeline engineering.
- Strong knowledge of Airflow, SQL, and relational database design.
- Hands‑on experience with AWS services and Docker containerization.
- Excellent problem‑solving skills and ability to work independently in a fast‑paced startup environment.
- Effective communication skills for collaborating with stakeholders and documenting solutions.
Skills
pythonairflowawssqldocker