onsite
Senior Data Engineer - Strategic Partnerships & IMPACT360
Data Engineer
Lead the design, development, and maintenance of scalable data pipelines and lakehouse solutions using AWS Glue, Lake Formation, Lambda, Athena, and Airflow to empower strategic partnership initiatives and impact analytics.
About the role
Key Responsibilities
- Architect and implement end‑to‑end data pipelines on AWS Glue and Airflow, ensuring high reliability and performance for partnership data feeds.
- Design and maintain secure, governed data lake environments with AWS Lake Formation, applying fine‑grained access controls and cataloging.
- Develop serverless data transformations and analytics using AWS Lambda and Amazon Athena, delivering real‑time insights to business stakeholders.
- Collaborate with data scientists, product managers, and external partners to translate business requirements into scalable data solutions.
- Monitor pipeline health, troubleshoot failures, and optimize costs through efficient resource utilization.
Requirements
- 5+ years of experience building data pipelines on AWS, with deep knowledge of Glue, Lake Formation, Lambda, Athena, and Airflow.
- Strong SQL skills and experience with data modeling for analytical workloads.
- Proficiency in Python or Scala for ETL development.
- Experience with data governance, security, and compliance best practices.
- Excellent communication skills and ability to work cross‑functionally in a fast‑paced environment.
Skills
apache sparksqlairflow