Inworld, an AI research lab and inference provider serving realtime LLM/speech models at massive scale (10T+ tokens/month), is hiring a Staff/Principal ML Engineer in Mountain View to optimize model inference and serving infrastructure. Core work spans serving frameworks like vLLM/TRT-LLM, GPU performance tuning in C++/CUDA/Rust, and distributed scaling on Kubernetes/Ray. Onsite role with relocati
About the role
About Inworld
Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.
Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.
We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs,