Perception Engineer

Team Introduction

The Perception team is responsible for developing CV/ML algorithms to understand the surroundings of ego vehicles in real time, including obstacle detection, online mapping, and scene understanding. The perception system takes inputs from multiple sensors across time, and outputs various obstacle-level and scene-level understandings for downstream modules such as prediction and planning, etc.

Responsibilities

• Develop and deploy cutting-edge perception and deep learning models, including computer vision models, vision-language and large language models (VLMs and LLMs), for real-time integration into our system.
• Create and optimize data pipelines for data mining, labeling, training, and evaluation, supporting comprehensive onboard development.
• Conduct advanced research in perception algorithms to address complex, real-world scenarios, focusing on areas like object detection, segmentation, road understanding, and motion prediction.
• Leverage multi-modal sensor fusion techniques to build robust architectures tailored for autonomous driving.