remoteonsite
Lead Data Engineer - Comprinno Technologies Pvt. Ltd.
Data Engineer
Lead Data Engineer driving cloud‑native data pipelines and AI solutions on AWS, architecting scalable analytics platforms, and guiding cross‑functional teams in data strategy and automation.
About the role
Key Responsibilities
- Design, build, and maintain end‑to‑end data pipelines and lakehouse architectures on AWS, ensuring high availability and performance.
- Lead the implementation of machine learning workflows, from data ingestion to model deployment and monitoring.
- Collaborate with product, engineering, and security teams to define data governance, compliance, and observability standards.
- Mentor and grow a team of data engineers, fostering best practices in coding, testing, and CI/CD.
- Drive automation of data operations using IaC, Terraform, and CI/CD pipelines to accelerate delivery cycles.
Requirements
- 8+ years of experience in data engineering, with a strong focus on AWS services (Glue, Redshift, Athena, S3, Lambda).
- Proficiency in Python, SQL, and modern data stack tools (dbt, Airflow, Snowflake).
- Hands‑on experience building ML pipelines and deploying models at scale.
- Deep understanding of DevOps practices, containerization (Docker, Kubernetes), and infrastructure automation.
- Excellent communication skills and a proven track record of leading technical teams.
Skills
pythonawsmachine learningsql