Software Engineer
Lead AI infrastructure engineering at Solo.io, building cloud-native solutions that move generative AI projects from pilot to production. Focus on scalable, production-ready ML pipelines using Python, Kubernetes, AWS, and Go, while contributing to high-impact open‑source projects.
Who we are.
Solo empowers teams to build and scale their AI infrastructure using cloud-native tech. Most companies have shifted from asking 'How can we make AI useful?' and are instead now asking 'How do we take our AI projects to production?'. A recent MIT study reveals a shocking 95% of GenAI projects never make it there or fail to deliver positive ROI. At Solo, our AI initiatives are helping teams bridge that gap from pilot to production.
With our roots in critical cloud infrastructure (gateways, proxies, service mesh) trusted by Fortune 500s, Solo is uniquely positioned to lead AI's next wave. As a nimble startup, we innovate faster, our engineers contribute to high-impact OSS (we're a top CNCF contributor) and solve real scalability challenges.
Solo is a VC-backed company, founded in 2017 by Idit Levine. In 2021, Solo was valued at $1B. Solo’s customers are some of the largest in the world, spanning all geographies and industries. Solo’s team has deep expertise in Cloud Computing, Linux, Containers, Kubernetes, Service Mesh, APIs, AI, Security, Networking, Microservice Applications and Infrastructure Modernization.
About the role.
This role will have opportunities to contribute to both our cloud networking stack and our AI products, as the line between the two is beginning to fade. Dive into OSS projects like kagent ( kagent.dev ) for Kubernetes-based AI orchestration, agentgateway ( agentgateway.dev ) which redefines proxies for AI workflows, and kgateway ( kgateway.dev ), our CNCF project handling billions of API calls. All of these projects integrate seamlessly with Istio’s Ambient Mesh ( ambientmesh.io ), a sidecar-less mesh pioneered by Solo to make service meshes easy and resource-efficient - driving a massive surge in adoption. You will have chances to work with customers, contribute to open source, and shape the future of AI infrastructure.
You will work with the latest cloud and container technologies like Kubernetes, Envoy, and Istio - as well as with AI tooling, protocols and standards like MCP, A2A and more! You will review customer feedback in order to promote adoption and simplify usability of complex technology.
This is a remote role for applicants based in the US. Unfortunately we are unable to sponsor work visas for this role at this time.
Job Description:
Posted June 22, 2026