onsite
Senior Data Engineering Tech Lead
Software Engineer
Lead a senior data engineering team building scalable AI agent pipelines on AWS, leveraging Glue, Lambda, Step Functions, and Athena to deliver robust data processing and analytics solutions.
About the role
Key Responsibilities
- Architect, design, and implement end‑to‑end data pipelines for AI agents using AWS Glue, Lambda, and Step Functions.
- Develop and optimize SQL queries and data models in Amazon Athena to support analytics and reporting.
- Mentor and guide a team of data engineers, establishing best practices for code quality, testing, and CI/CD.
- Collaborate with data scientists, product managers, and infrastructure teams to translate business requirements into scalable data solutions.
- Monitor pipeline performance, troubleshoot issues, and continuously improve reliability and cost efficiency.
Requirements
- 5+ years of hands‑on experience building data pipelines on AWS, with deep expertise in Glue, Lambda, Step Functions, and Athena.
- Strong programming skills in Python and proficiency with SQL for data transformation and analysis.
- Proven experience leading technical teams, driving architectural decisions, and mentoring engineers.
- Solid understanding of data modeling, ETL best practices, and cloud‑native data architectures.
- Excellent problem‑solving abilities and communication skills to work cross‑functionally.