onsite
Staff Software Engineer, Machine Learning, DUE ML Core
Staff Software Engineer, Machine Learning, DUE ML Core
The Staff Software Engineer, Machine Learning, DUE ML Core will develop and apply advanced machine learning techniques, with a focus on Reinforcement Learning and Generative AI, to enhance the evaluation systems and driving performance of the Waymo Driver. This role involves building scalable systems for training large-scale generative models, leading the implementation of novel RL algorithms, and developing Deep Learning solutions for autonomous driving analysis.
About the role
About the Role
The DUE ML Core London team at Waymo builds and operates scalable machine learning systems, simulation workflows, and insight tools designed to improve the evaluation and developer onboarding journeys. By combining expert human judgment with advanced machine learning models, they deliver training and evaluation data for hundreds of metrics and components that comprise the Waymo Driver. We are looking for researchers and software engineers passionate about developing ML techniques for evaluation systems and driving performance improvements across our technology stack.
You will:
- Build scalable systems for training and fine-tuning large-scale generative models to produce realistic and evaluate interesting driving behaviors.
- Lead the implementation and iteration of novel RL algorithms, reward functions, and training paradigms tailored for generating high-fidelity and insightful driving behaviors.
- Lead the development of cutting-edge Deep Learning models and Generative AI (LLM/VLM) solutions to enhance human-led triaging, introduce automation for high-volume workflows, and perform nuanced analysis of self-driving behavior to detect critical anomalies.
- Oversee the production and optimization of machine learning models aiming to assess Waymo’s expansive fleet of vehicles that cumulatively travel millions of miles.
- Proactively monitor and assimilate best practices from within Alphabet and the broader industry to develop a novel Reinforcement Learning from Human Preference (RLHF) based data collection and evaluation system.
- Collaborate closely with multiple teams (e.g., Prediction, Planning, Research), other technical leads, and senior leaderships across Waymo to deliver on key strategic efforts.
You have:
- M.S. or Ph.D. degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical field, or equivalent practical experience.
- 5+ years of hands-on experience in developing and applying Machine Learning models, with a significant focus on Reinforcement Learning.
- Demonstrated expertise in deep learning, sequence modeling, and generative models.
- Strong publication record or history of impactful project delivery in RL or related areas.
- Proficiency in Python and standard ML frameworks (e.g., JAX, TensorFlow).
- Experience with large-scale distributed training and data processing.
- Proven ability to lead complex and ambiguous technical projects from conception to completion.
We prefer:
- 7+ years of relevant experience in ML/RL research and application.
- Experience in the autonomous vehicles domain, robotics, or complex simulation environments.
- Deep understanding of state-of-the-art RL techniques, including those used for fine-tuning large models (e.g., from human feedback/preferences).
- Familiarity with large-scale simulation platforms and their integration with ML training workflows.
- Experience designing and using metrics for evaluating complex AI systems.
- Track record of technical leadership, influencing senior stakeholders, and driving innovation across team boundaries.
- Excellent communication skills, with the ability to articulate complex technical concepts clearly.