Lead AI Engineer - CACI International Inc

The Opportunity: We are seeking a system/software engineer to research, design and build Artificial Intelligence (AI) and Machine Learning (ML) solutions.As part of our team, you will help lay the foundation for future AI/ML initiatives while contributing to broader software development projects.You will work closely with a small cross-functional team to gather requirements, design, develop, and implement AI-driven features, seamless integrations, and deployment pipelines across a range of AI/ML use cases, including Generative AI. Responsibilities: • Forward thinking vision of how RAG can be integrated within a software development lifecycle and business practices, keeping abreast of new developments in RAG, NLP, and related fields. • Designing and implementing retrieval systems: Creating efficient ways to store and quickly access large amounts of relevant information. • Implementing safeguards: Developing mechanisms to prevent the system from retrieving or generating inappropriate or harmful content. • Developing and fine-tuning language models: Working with large language models to optimize their performance for specific tasks and domains. • Evaluation and testing: Designing and conducting tests to measure the system's accuracy, relevance, and overall performance. • Integrating retrieval and generation components: Ensuring seamless interaction between the retrieval system and the language model. • Follow a CACI agile methodology, attending daily standups, refinement sessions, and updating agile project management system to ensure transparency • Design and implement agentic workflows using supervisor and orchestration patterns with frameworks such as LangGraph, CrewAI, or similar multi-agent orchestration tools • Establish observability and evaluation pipelines using tools like Langfuse, LangSmith, or similar platforms to monitor, trace, and assess LLM application performance Qualifications: Required: o Bachelor's degree in computer science, software engineering, or a related field. o 7 years of software development experience with 2-5 years of relevant experience in NLP, machine learning, or AI development o Experience designing agentic flows using supervisor, routing, and hierarchical patterns with frameworks such as LangGraph or equivalent o Experience with Linux and Linux based terminals o Understanding of RAG architecture and principles, experience implementing RAG systems, and familiarity with popular RAG frameworks and tools. o Knowledge of security best practices for AI systems o Strong programming skills, particularly in Python, Javascript, rust, golang o Experience with vector databases, embedding techniques, and data pipelines o Experience with information retrieval systems o Experience with RESTful APIs and Cloud Services (AWS, OCI) o Experience with data preprocessing, normalization, cleaning, encoding data into vector representations o Knowledge of text analytics and semantic search techniques

o Experience with pro