remote
Sr. Software Engineer II - AI - iHerb
Software Engineer
Lead the design and production of GenAI‑powered product experiences, building RAG pipelines, LLM‑driven personalization, and conversational agents while ensuring robust MLOps and guardrails for repeatable, production‑grade AI features.
About the role
Key Responsibilities
- Architect and implement Retrieval‑Augmented Generation (RAG) pipelines over the company catalog and customer reviews to power personalized search and recommendation features.
- Develop and maintain LLM‑driven personalization engines and conversational Wellness Agents that interact with users across multiple touchpoints.
- Design and deploy agentic workflow systems, integrating tool use and external APIs to automate internal business processes such as marketing automation and business intelligence.
- Build and maintain the MLOps layer, including model training, evaluation, monitoring, and continuous deployment pipelines to ensure AI features are production‑grade and repeatable.
- Collaborate with cross‑functional teams to define guardrails, safety checks, and evaluation frameworks that uphold data privacy and compliance standards.
Requirements
- 5+ years of software engineering experience with a strong focus on AI/ML product development.
- Proficiency in Python and experience building RAG pipelines and LLM‑based applications.
- Hands‑on experience with MLOps tools and practices (CI/CD, monitoring, model versioning).
- Deep understanding of conversational AI, agent frameworks, and tool integration.
- Excellent problem‑solving skills and the ability to translate business needs into scalable technical solutions.