onsite
Staff / Principal Machine Learning Engineer, Multimodal LLM
Staff / Principal Machine Learning Engineer, Multimodal LLM
As a Staff / Principal Machine Learning Engineer specializing in Multimodal LLMs, you will lead the development of advanced large language models to improve the understanding of complex urban environments for Zoox's robotaxis. Your responsibilities include designing model architectures, driving ML solutions from research to production, and collaborating with various teams to integrate and optimize these models for autonomous driving.
About the role
About the Role
As a Staff / Principal Machine Learning Engineer focused on Multimodal LLMs, you will play a pivotal role in advancing the capabilities of Zoox's robotaxis. Your work will directly enhance the robotaxis' understanding of complex urban environments by developing cutting-edge multimodal large language models.
Responsibilities
- Lead the development of multimodal large language models that enhance our robotaxis' understanding of complex urban environments.
- Design effective model architectures and sophisticated training techniques, leveraging all the inputs from our sensor stack and the overall large scale data we have at Zoox.
- Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities.
- Collaborate with perception, planning, safety, and systems teams to integrate your models into the vehicle's decision-making pipeline.
- Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system.
Skills
Multimodal Large Language ModelsMLmodel architecturestraining techniquessensor stackData PipelinesAutonomous DrivingPerceptionPlanningSafetySystems