onsite
Senior Lead AI Engineer Foundations, LLM Core, Agentic AI - Capital One
AI Engineer
Lead the design and delivery of foundational AI platforms, LLM core services, and agentic AI solutions, driving responsible, production‑grade models using Python, deep‑learning frameworks, and cloud-native infrastructure.
About the role
Key Responsibilities
- Architect and build scalable AI foundations, including model training pipelines, inference services, and LLM core components.
- Design, implement, and optimize agentic AI systems that integrate with banking products while ensuring safety, fairness, and compliance.
- Lead a multidisciplinary team of engineers and data scientists, providing technical mentorship and establishing best practices for MLOps, CI/CD, and monitoring.
- Collaborate with product and security stakeholders to translate business requirements into robust AI solutions deployed on AWS and Kubernetes.
- Drive research‑to‑production efforts, evaluating emerging LLM architectures, prompt‑engineering techniques, and responsible AI frameworks.
Requirements
- 10+ years of software engineering experience with deep expertise in Python and modern deep‑learning libraries such as PyTorch or TensorFlow.
- Proven track record delivering large‑scale LLM or generative AI services in a cloud environment (AWS preferred) and container orchestration (Kubernetes).
- Strong understanding of prompt engineering, retrieval‑augmented generation, and agentic AI patterns.
- Experience leading technical teams, establishing MLOps pipelines, and ensuring model governance, bias mitigation, and security.
- Advanced degree (MS/PhD) in Computer Science, Machine Learning, or related field is a plus.
Skills
pythonpytorchtensorflowawskubernetes