hybrid
Member of Technical Staff, Kernels
Member of Technical Staff, Kernels
As a Kernel Engineer at Magic, you will be responsible for designing, implementing, and maintaining high-performance kernels to optimize throughput and latency during training and inference, specifically addressing challenges related to long-context windows. This involves developing and optimizing GPU kernels within various frameworks and potentially porting them to alternative hardware options.
About the role
About the role
As a Kernel Engineer, you will design, implement, and maintain high-performance kernels to optimize throughput and latency during training and inference. Magic's long-context windows create distinct kernel optimization challenges around memory utilization, data movement, and sustained throughput.
What you'll work on
- Design and implement kernels that support high-performance long-context behavior
- Ownership of kernel design, implementation, deployment, and production reliability
- Focus on robustness, extensive testing, and functional correctness, while pushing on performance
- Evaluate porting Magic’s compute kernels to alternative hardware options
- Co-design kernels with understanding and interaction with training, inference, and RL teams
- For a sample of our work, see Magic-Attention, presented at GTC 2026
What we’re looking for
- Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs
- Develop and optimize GPU kernels in frameworks such as NCCL, MSCCLPP, CUTLASS, CuTeDSL, Triton, Quack, Flash-Attention, and similar frameworks
- Experience in other kernel authoring frameworks such as Pallas/Mosaic (GPU or TPU), or Mojo also maps well to the work on Magic's kernel team
- Strong depth over shallow breadth: for kernel engineering, we prefer candidates with deep expertise in computer architecture, low-level machine optimizations, and code generation, with breadth across ML
- Agility, ownership mindset, and grit
Our culture
- Integrity. Words and actions should be aligned
- Hands-on. At Magic, everyone is building
- Teamwork. We move as one team, not N individuals
- Focus. Safely deploy AGI. Everything else is noise
- Quality. Magic should feel like magic