onsite
Data Flow Engineer - Clearwater Analytics (CWAN)
Software Engineer
Data Flow Engineer responsible for building and maintaining data pipelines, validating client data, automating monitoring, and normalizing external datasets using Python, SQL, and API integration to support auto‑reconciliation and portfolio ingestion.
About the role
Key Responsibilities
- Import, validate, and transform client file deliveries into a standardized format for ingestion.
- Automate daily monitoring, reporting, and alerting of data pipeline health.
- Establish and maintain connections to external APIs and FTP sources for portfolio data.
- Ensure timely, reliable consumption of external data and troubleshoot issues.
- Collaborate with data and engineering teams to refine data models and improve auto‑reconciliation processes.
Requirements
- Proficiency in Python and SQL for data extraction, transformation, and validation.
- Experience designing and maintaining ETL pipelines and automating workflows.
- Strong understanding of API integration, FTP, and data ingestion best practices.
- Excellent problem‑solving skills and attention to detail in data quality.
- Ability to work collaboratively in a fast‑paced, iterative environment.