remote
Senior Data Engineer - Bupa
Data Engineer
Senior Data Engineer driving scalable data pipelines and analytics solutions using Python, SQL, AWS, and Spark to empower healthcare insights and innovation.
About the role
Key Responsibilities
- Design, develop, and maintain robust data pipelines that ingest, transform, and store large volumes of healthcare data across AWS services.
- Implement ETL processes using Python and Spark, ensuring data quality, consistency, and compliance with regulatory standards.
- Collaborate with data scientists and product teams to deliver actionable insights and support advanced analytics initiatives.
- Optimize performance and cost of data workflows through efficient architecture and resource management.
- Document data models, pipeline logic, and best practices for future maintenance and scalability.
Requirements
- 5+ years of experience in data engineering, preferably in a healthcare or regulated environment.
- Proficiency in Python, SQL, and Spark for large‑scale data processing.
- Hands‑on experience with AWS services such as S3, Redshift, Glue, and Lambda.
- Strong understanding of data modeling, ETL design patterns, and data governance.
- Excellent problem‑solving skills and ability to work collaboratively in a cross‑functional team.