remote
Data Engineer - Outmarket AI
Data Engineer
Data Engineer building scalable, SOC‑2 compliant data pipelines on AWS, transforming insurance documents into actionable insights using Python, SQL, and advanced ETL techniques.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines that ingest, transform, and store large volumes of insurance data on AWS services.
- Implement data modeling and schema design to support downstream analytics and AI workloads.
- Optimize ETL processes for performance, reliability, and cost efficiency using Python, SQL, and AWS Glue/EMR.
- Collaborate with data scientists and product teams to ensure data quality, lineage, and compliance with SOC 2 Type II standards.
- Monitor pipeline health, troubleshoot issues, and continuously improve data workflows.
Requirements
- 3+ years of experience as a Data Engineer in a cloud environment.