Senior TLM, Machine Learning Infrastructure

About Waymo

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes. The Waymo Driver powers Waymo’s fully autonomous ride-hail service and can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver has provided over ten million rider-only trips, enabled by its experience autonomously driving over 100 million miles on public roads and tens of billions in simulation across 15+ U.S. states.

About the Team

The Waymo ML Infrastructure team accelerates Waymo’s mission by building the best ecosystem for sustainably innovating and shipping ML powered intelligence. Research, Production, and the Hardware teams are our primary stakeholders, and our work powers the development of state-of-the-art models in the areas of Perception and Trajectory planning that are core to our autonomous driving software. We enable our partners by offering best-in-class solutions for the entire model development lifecycle. These solutions include understanding the model business goals and platform hardware characteristics, and codesigning the models for the hardware. These solutions are developed in close collaboration with different modeling teams. Scale and efficiency are core tenets our infra follows.

About the Role

We are looking for an experienced Senior TLM to join our team. In this critical role, you will lead the development and enable efficient deployment for large-scale machine learning models using state-of-the-art advanced AI infrastructure. You will work cross-functionally at the intersection of data engineering, model development, and Datacenter + on-device low-latency deployments, ensuring seamless integration across teams and technologies to power efficient innovation.

Responsibilities

• Take ownership of improving model efficiency on different platforms and drive the model system codesign practice that meet both technical and business requirements. You will work with cutting-edge ML models that may consist of multiple billions of parameters, and apply your expertise in model optimizations and advanced algorithms toward efficient execution and deliver results on multiple hardware compute platforms.
• Technical Leadership: Proactively study the SOTA model architectures and optimizations from the community and Google, for World Models, Diffusion + flow matching techniques, and translate them into measurable technical deliverables in Waymo’s onboard driving stack.
• Performance Analysis: Dev tooling innovation for model performance inspector in highly distributed training/inference setups, apply roofline analysis, understand the efficiency headrooms and drive work groups to deliver the optimizations and meet the system requirements.
• Strong Execution: Innovate high performance optimizations and tools for various models and large-scale training/inference including on future next-gen TPUs and low-bit precision training/inference setup, and ensure all system components align towards achieving high performance and goodput goals.
• Cross-Team Leadership: Guide efforts across multiple teams and organizations to ensure seamless integration of data generation, model development, and deployment pipelines.
• Mentorship & Management: Act as a mentor to junior engineers, helping to grow their technical expertise and foster a culture of collaboration and engineering excellence. Manage the IC performance for a medium size team of ~10 engineers.

Requirements

• 10+ years of professional software engineering experience, with at least 5 years in machine learning infrastructure such as developing, training, deploying, and optimizing large-scale machine learning systems.
• Experienced using ML accelerator profiling tools to uncover performance bottlenecks.
• Solid experience in the development and optimization of machine learning infrastructure tools like DeepSpeed, PyTorch, TensorFlow, JAX, or similar frameworks.
• Deep understanding of state-of-the-art machine learning models and architectures such as autoregressive and diffusion transformers and familiarity with custom-kernels for diverse h/w compute based efficiency.
• Strong leadership skills with experience navigating cross-functional teams and providing technical leadership projects across multiple organizations.
• Excellent communication skills, both verbal and written, with the ability to translate complex technical concepts for a broad audience.
• A Master’s or PhD in Computer Science, Engineering, or a related field is preferred.