onsite
Senior Technical Program Manager - Customer Experience & Business Trends - Amazon
Product Manager
Lead cross‑functional initiatives to build advanced GenAI evaluation tools, benchmark LLM and multi‑modal model performance, and drive data‑driven improvements in customer experience.
About the role
Key Responsibilities
- Own the end‑to‑end delivery of GenAI model assessment products, coordinating engineering, data science, and product teams.
- Define and execute evaluation frameworks for LLMs, multi‑modal models, and LLM‑based agents, ensuring rigorous performance benchmarks.
- Translate customer experience metrics into actionable insights, guiding model optimization and feature prioritization.
- Manage program timelines, risks, and stakeholder expectations across multiple business units.
- Champion data‑driven decision making, presenting findings to senior leadership and external partners.
Requirements
- 10+ years of experience in technical program management within AI/ML or large‑scale data platforms.
- Deep understanding of GenAI technologies, LLMs, and multi‑modal model evaluation.
- Proven track record delivering complex, cross‑functional programs on schedule.
- Strong analytical skills with proficiency in data analysis and performance metrics.
- Excellent communication and stakeholder management abilities.