Research Scientist, AI Foundations (LLM Distillation)

About the Role

The mission of the Waymo AI Foundations team is to develop machine learning solutions addressing open problems in autonomous driving, towards the goal of safely operating Waymo vehicles in dozens of cities and under all driving conditions. As part of our work, we also initiate and foster collaborations with other research teams in Alphabet. AI Foundations areas that we are currently focusing on include reinforcement learning, learning from demonstration, generative modeling, Bayesian inference, hierarchical learning, and robust evaluation.

This role follows a hybrid work schedule and you will report to a Research Director of AI Foundations.

Responsibilities

• Work on distillation from large foundation models to smaller real-time models.
• Explore LLM/VLM distillation recipes to maximally transfer the quality gains from teachers.
• Customize distillation data and recipe for business-critical Semantics tasks

Requirements

• Experience in building large-scale deep learning systems.
• Experience in VLM/LLM models.

Preferred Qualifications

• Experience in training or deploying multi-modal LLMs.
• Distillation related experience.