Software Engineer, AI Gateway
As a Software Engineer on the AI Gateway Team, you will develop and enhance a platform providing a unified API for hundreds of AI models, focusing on building reliable, low-latency systems with features like rate limiting and intelligent failovers. You will ensure production-ready reliability for AI workloads and collaborate on integrating new AI providers and models.
As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.
Posted June 2, 2026