remote
Manager, Data Engineering - Navitus Health Solutions / Lumicera Health Services
Software Engineer
Lead a high‑performing data engineering team to design, build, and maintain scalable data pipelines and analytics platforms using Python, SQL, AWS, Spark, and Airflow, driving data‑driven decision making across the organization.
About the role
Key Responsibilities
- Lead the design, development, and deployment of end‑to‑end data pipelines that ingest, transform, and store large volumes of structured and unstructured data.
- Architect and maintain scalable data infrastructure on AWS, leveraging services such as S3, Redshift, Glue, and EMR.
- Implement and optimize Spark jobs and Airflow workflows to ensure high‑throughput, low‑latency data processing.
- Collaborate with data scientists, product managers, and business stakeholders to translate analytical requirements into robust data solutions.
- Mentor and grow a team of data engineers, fostering best practices in coding, testing, and documentation.
Requirements
- 5+ years of experience in data engineering, with a proven track record of building production‑grade data pipelines.
- Strong proficiency in Python, SQL, and experience with Spark and Airflow.
- Hands‑on experience with AWS data services (S3, Redshift, Glue, EMR).
- Excellent problem‑solving skills and ability to work in a fast‑paced, collaborative environment.
- Experience leading and scaling a data engineering team is highly desirable.
Skills
pythonsqlawsapache sparkairflow