remote
Data Platform Engineer Infrastructure & Integrations - Yapily
Data Engineer
Data Platform Engineer focused on building scalable, cloud‑native data pipelines and integrations using Python, AWS, Kubernetes, and Terraform to support next‑generation financial services.
About the role
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and integration services on AWS.
- Implement and manage Kubernetes clusters and Terraform scripts for infrastructure automation.
- Build robust ETL workflows, ensuring data quality, lineage, and performance.
- Collaborate with data scientists and product teams to expose data assets via APIs and data catalogs.
- Monitor, troubleshoot, and optimize data platform components for reliability and cost efficiency.
Requirements
- 3+ years of experience in data engineering with Python and SQL.
- Hands‑on expertise with AWS services (S3, Redshift, Glue, Lambda) and Kubernetes.
- Proficiency in Terraform or similar IaC tools for cloud infrastructure.
- Strong understanding of ETL concepts, data modeling, and data quality practices.
- Excellent problem‑solving skills and a collaborative mindset.
Skills
pythonawskubernetesterraformsql