Inference Technical Lead, Sora

About the Team

The Sora team is pioneering multimodal capabilities for OpenAI’s foundation models. We’re a hybrid research and product team focused on integrating multimodal functionalities into our AI products, ensuring they are reliable, user-friendly, and aligned with our mission of broad societal benefit.

About the Role

We’re looking for a GPU Inference Engineer to contribute to improvements in model serving efficiency for Sora. This is a high-impact role where you’ll drive initiatives to optimize inference performance and scalability. You’ll also be engaged in model design, to help assist our researchers in developing inference-friendly models.

This role is critical to scaling the team’s broader goals - it will directly enable leadership to focus on higher-leverage initiatives by building a stronger technical foundation.

In this role you will:

• Perform engineering efforts focused on improving model serving, inference performance, and system efficiency
• Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability
• Partner closely with research and product teams to ensure our models perform effectively at scale
• Design, build, and improve critical serving infrastructure to support Sora’s growth and reliability needs

You might thrive in this role if you:

• Have deep expertise in model performance optimization, particularly at the inference layer
• Have a strong background in kernel-level systems, data movement, and low-level performance tuning
• Are excited about scaling high-performing AI systems that serve real-world, multimodal workloads
• Can navigate ambiguity, set technical direction, and drive complex initiatives to completion