remote
Senior Data Engineer - Insurance Data Platform - CCMSI
Data Engineer
Senior Data Engineer responsible for designing, building, and optimizing large‑scale data pipelines and warehouses for an insurance claims platform, leveraging Python, SQL, Snowflake, Airflow, and AWS services.
About the role
Key Responsibilities
- Design, develop, and maintain robust ETL pipelines to ingest, transform, and load high‑volume insurance data from multiple sources.
- Build and optimize Snowflake data warehouses, ensuring performant data models and query efficiency.
- Implement workflow orchestration using Apache Airflow, including scheduling, monitoring, and error handling.
- Collaborate with data scientists, analysts, and product teams to define data requirements and deliver reliable data products.
- Apply best practices for data security, governance, and compliance within AWS cloud environments.
- Continuously improve data quality, reliability, and scalability through automated testing and performance tuning.
Requirements
- 5+ years of professional experience in data engineering or related fields.
- Strong proficiency in Python and SQL for data manipulation and pipeline development.
- Hands‑on experience with Snowflake, AWS services (S3, Redshift, Lambda, etc.), and Apache Airflow.
- Solid understanding of data modeling, warehouse design, and ETL best practices.
- Experience working with large, complex datasets in the insurance or financial services domain is a plus.
Skills
pythonsqlsnowflakeaws