remote
Lead Data Engineer - ABC Fitness India Pvt Ltd
Data Engineer
Lead the design and implementation of scalable data pipelines using Python, Spark, and AWS services, driving data-driven insights for a fast‑growing fitness platform.
About the role
Key Responsibilities
- Architect, develop, and maintain end‑to‑end data pipelines that ingest, transform, and store large volumes of fitness and user data.
- Lead a small team of data engineers, providing mentorship, code reviews, and technical guidance.
- Design and enforce data quality, governance, and security standards across all data assets.
- Collaborate with data scientists, product managers, and stakeholders to translate business requirements into robust data solutions.
- Optimize pipeline performance and cost on AWS, leveraging services such as S3, Redshift, Glue, and EMR.
Requirements
- 5+ years of experience in data engineering with a strong background in Python and SQL.
- Proficiency with Apache Spark, Airflow, and containerization (Docker).
- Hands‑on experience deploying and managing data workflows on AWS.
- Excellent problem‑solving skills and a passion for clean, maintainable code.
- Strong communication skills and ability to work cross‑functionally in a fast‑paced environment.
Skills
pythonsqlapache sparkawsairflowdocker