onsite
Senior Lead AI Engineer LLM Gateway, FM Hosting - Capital One
AI Engineer
Lead the design and deployment of large‑language‑model gateways and financial‑model hosting solutions, driving responsible AI at scale with Python, AWS, and DevOps practices.
About the role
Key Responsibilities
- Architect and lead the development of LLM gateway services that enable real‑time, personalized banking experiences.
- Design and maintain scalable, secure hosting environments for financial models on AWS, ensuring high availability and compliance.
- Collaborate with data scientists, product managers, and security teams to define model governance, monitoring, and bias mitigation strategies.
- Implement CI/CD pipelines, automated testing, and observability for AI workloads using DevOps best practices.
- Mentor a cross‑functional team of engineers, fostering a culture of continuous learning and technical excellence.
Requirements
- 10+ years of software engineering experience with a strong focus on machine learning and AI systems.
- Proficiency in Python, experience with LLM frameworks (e.g., Hugging Face, OpenAI API), and deep knowledge of AWS services (SageMaker, ECS, Lambda).
- Hands‑on experience building production‑grade ML pipelines, model serving, and monitoring.
- Solid understanding of DevOps principles, CI/CD, containerization (Docker, Kubernetes), and infrastructure as code.
- Excellent communication skills and a proven track record of leading technical teams in a fast‑paced environment.
Skills
pythonmachine learningaws