onsite
Senior AI Platform Software Engineer - UL Solutions
Software Engineer
Lead the design and deployment of AI‑powered services, building scalable REST/GraphQL APIs, orchestrating LLMs with LangChain, and managing data pipelines and vector stores on Azure. Strong focus on Docker/Kubernetes, monitoring, and performance tuning.
About the role
Key Responsibilities
- Design and implement high‑performance RESTful or GraphQL APIs to expose AI model functionality using Python and FastAPI.
- Integrate large language models via Azure OpenAI / Azure AI Foundry and custom ML models into backend architectures, leveraging LangChain and LangGraph for orchestration.
- Build and maintain data ingestion pipelines and vector databases (Pinecone, Weaviate, Azure AI Search) to support Retrieval‑Augmented Generation (RAG) workflows.
- Deploy and manage services with Docker and Kubernetes across Microsoft Azure (AKS, Azure ML, Azure AI Foundry), ensuring scalability and reliability.
- Implement real‑time monitoring, alerting, and drift detection for both LLMs and traditional ML models, and design comprehensive testing strategies for non‑deterministic outputs.
Requirements
- 5+ years of software engineering experience with a focus on AI/ML platforms.
Skills
pythonlangchainfastapidockerkubernetes