remote
Staff / Principal Software Engineer - Canada
Software Engineer
Staff/Principal backend engineer at Inworld, a realtime AI research lab and inference provider, building core platform systems: the Inworld Router (multi-provider LLM routing with failover, cost/latency optimization), realtime APIs, and TTS/STT model services. Backend work in Go/Python/C++/Rust with cloud-scale serving, relational DBs, caching, and data pipelines.
About the role
About Inworld
Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.
Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.
We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs,
Skills
aianalyticsapiclickhousecloudcppdata pipelinesflinkinfluxdbllmmachine learningmemcachedmysqlobservabilityopentelemetrypostgresqlpythonredisrust