The Role
As a Member of Technical Staff, System Modeling (Performance Models), you will be part of a hands-on R&D team building simulation frameworks that enable evaluation and rapid iteration across all layers of unconventional physics-based computing systems for machine learning workloads. “Extreme co-design” is our guiding principle.
System Modeling is a multi-disciplinary effort, and the team we’re building reflects that. The role involves development of physics-based system models, GPU-accelerated ML system simulations, and cross-layer system integration. You don’t need to be an expert in all of these, but you have to be very strong in at least one, and solid in the rest.
Responsibilities
You will be responsible for one or more of the following tasks:
- Building extensible and composable high-fidelity power, performance and area estimation tools for novel AI acceleration system architectures to enable rapid design space exploration.
- Define and create comparative analyses across candidate architectures and existing state-of-art implementations.
- Working with other teams to understand their needs for such modeling and simulation to support high level system design as well as lower level verification of hardware.
Minimum Qualifications
- Education
- MS/PhD in a quantitative field (AI/ML, Computer Science, Physics, Electrical Engineering, Applied Math), or BS with substantial, clear evidence of equivalent research/engineering depth.
- Performance Modeling Knowledge
- Experience with tools and development for power profiling, modeling and simulation for AI workloads.
- Deep understanding of spatial architectures and data orchestration mechanisms
- Deep understanding of different dataflow strategies and their tradeoffs, e.g. Weight-Stationary (WS), Output-Stationary (OS), Input-Stationary (IS) and Row-Stationary (RS).
- Familiar with (OSS) tools for hardware accelerator design: TimLoop, Accelergy, NeuroSim, CIMLoop, CACTI, etc.
- Familiar with different existing systolic array accelerator architectures for AI/ML workloads
- ML and systems fluency
- Solid understanding of modern AI/ML architectures and training/inference workflows.
- Strong experience implementing and debugging ML models in PyTorch (preferred) or similar, with practical experience profiling, optimizing, and stabilizing non-trivial large-scale ML systems.
Preferred Qualifications
We are looking for well-rounded candidates. While the minimum qualifications focus on the core modeling and ML expertise, candidates who possess the following qualities will be the most impactful.
- Dynamic systems knowledge