onsite
Principal Data Platform Engineer - MedRisk LLC
Data Engineer
Senior technical leader driving the design, architecture, and evolution of a scalable enterprise data platform, enabling trusted analytics, business intelligence, and AI/ML at scale using Python, SQL, AWS, Spark, and data lake technologies.
About the role
Key Responsibilities
- Define and own the technical vision and architecture for the enterprise data platform, ensuring scalability, reliability, and security.
- Lead platform-wide design decisions, including data lake, data warehouse, and streaming pipelines to support analytics and AI/ML workloads.
- Collaborate with data scientists, analysts, and product teams to translate business requirements into robust data solutions.
- Implement best practices for data governance, metadata management, and data quality across the platform.
- Mentor and coach data engineering teams, fostering a culture of continuous improvement and innovation.
Requirements
- 10+ years of experience in data engineering, with a strong focus on large-scale data platform design.
- Proficiency in Python, SQL, and experience with AWS services (S3, Redshift, Glue, EMR).
- Hands‑on expertise with Apache Spark, data lake architectures, and ETL/ELT pipelines.
- Deep understanding of data governance, security, and compliance best practices.
- Excellent communication skills and a proven ability to influence cross‑functional stakeholders.
Skills
pythonsqlawsapache spark