remote
Principal Engineer - AI Platform - iHerb
Software Engineer
Lead the design and delivery of an AI‑native platform, driving LLM‑powered recommendations, RAG, and generative experiences on AWS, while setting architectural standards and mentoring cross‑functional teams.
About the role
Key Responsibilities
- Own the end‑to‑end technical strategy for the AI Platform, ensuring scalable, secure, and high‑performance delivery of LLM‑driven features.
- Resolve complex architectural challenges, establishing best practices for model deployment, data ingestion, and real‑time inference.
- Collaborate with product, data science, and infrastructure teams to integrate RAG pipelines, generative agents, and recommendation engines into the user experience.
- Mentor and influence engineering managers and peer principals, driving a culture of technical excellence and continuous improvement.
- Champion cloud‑native solutions on AWS, leveraging services such as SageMaker, Lambda, and ECS to optimize cost and performance.
Requirements
- 10+ years of software engineering experience with a strong focus on AI/ML systems.
- Proven expertise in Python, large‑language‑model deployment, and RAG architectures.
- Hands‑on experience with AWS AI/ML services and container orchestration (Kubernetes/ECS).
- Excellent communication skills and a track record of influencing cross‑functional teams.
- Deep understanding of data privacy, security, and compliance in AI deployments.
Skills
pythonmachine learningawsllmrag