hybrid
Staff Software Engineer, GPU Inference
Software Engineer
Staff engineer who productionizes and optimizes Cerebras's GPU-accelerated LLM inference serving stack — building the prefill path across custom inference APIs, vLLM, PyTorch, and the AMD ROCm stack on a rack-scale GPU fleet, owning reliability, numerical correctness, and performance (time to first token, throughput, tail latency).
About the role
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.
This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.
About the Role
Cerebras is building a new generation of disaggregated AI inference systems that combine GPU-accelerated prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine.
We are hiring a Software Engineer to productionize and optimize
Skills
agentic aiaiapiautomationccpacloudcppcudadistributed systemsfirmwarekuberneteslinuxllmmachine learningmultithreadingnetworkingobservabilityopenaipythonpytorchquantizationtensorrttriton