Senior Data Engineering Analyst - Optum

Key Responsibilities

• Design, develop, and maintain robust batch and streaming data pipelines that ingest, transform, and load large volumes of healthcare data.
• Collaborate with data scientists, analysts, and product teams to understand data requirements and translate them into efficient data models and workflows.
• Optimize pipeline performance and reliability using Spark, SQL, and cloud services such as AWS Glue, S3, and Redshift.
• Implement data quality checks, monitoring, and alerting to ensure data integrity and compliance with regulatory standards.
• Document architecture, processes, and best practices for future maintenance and knowledge transfer.

Requirements

• 5+ years of experience in data engineering with a strong focus on pipeline development.