onsite
Director of Data Engineering - MCKESSON
Engineering Manager
Lead a high‑performing data engineering team to design, build, and scale robust data pipelines and warehouses using Python, Spark, SQL, and AWS services, driving analytics and business insights.
About the role
Key Responsibilities
- Define and execute the data engineering strategy, aligning architecture with business goals and analytics needs.
- Lead, mentor, and grow a team of data engineers, fostering best practices in code quality, testing, and documentation.
- Design, develop, and maintain scalable ETL pipelines using Python, Apache Spark, and Airflow to ingest and transform large‑volume healthcare data.
- Architect and optimize cloud‑based data warehouses on AWS (Redshift, S3, Glue) for high performance and cost efficiency.
- Collaborate with data scientists, product managers, and business stakeholders to deliver reliable data products and enable self‑service analytics.
- Establish governance, security, and compliance frameworks for data handling in accordance with industry regulations.
Requirements
- 10+ years of experience in data engineering, with at least 3 years in a leadership role.
- Strong proficiency in Python, SQL, and big‑data processing frameworks such as Apache Spark.
- Extensive hands‑on experience with AWS data services (Redshift, S3, Glue, Lambda) and modern data warehousing concepts.
- Proven track record designing and operating scalable ETL pipelines and workflow orchestration tools like Airflow.
- Excellent communication and stakeholder management skills, with the ability to translate technical solutions into business value.
Skills
pythonsqlapache sparkawsairflow