remote
Data Engineering Manager - Axis Max Life Insurance
Engineering Manager
Lead a data engineering team to design, build, and maintain scalable AWS‑based data pipelines and analytics platforms, leveraging Python, SQL, Spark, and Airflow to enable data‑driven decision making.
About the role
Key Responsibilities
- Architect, develop, and operate robust data pipelines on AWS services such as S3, Redshift, Glue, and EMR.
- Lead a team of data engineers, providing technical guidance, code reviews, and mentorship.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable data solutions.
- Implement workflow orchestration using Apache Airflow and ensure reliable job scheduling and monitoring.
- Optimize data models and query performance in SQL and Spark environments for high‑volume analytics.
Requirements
- 5+ years of hands‑on experience building data pipelines on AWS, with deep knowledge of services like S3, Redshift, Glue, and EMR.
- Proficiency in Python and SQL for data transformation and scripting.
- Strong experience with Apache Spark for large‑scale data processing.
- Hands‑on experience with Apache Airflow or similar orchestration tools.
- Demonstrated ability to lead technical teams and deliver production‑grade data solutions.
Skills
awspythonsqlapache spark