remote
Tokens-as-a-Service TaaS Software Engineer - openai
Software Engineer
Seeking a TaaS Software Engineer to build systems for converting infrastructure capacity into reliable token throughput for OpenAI workloads. Focus on performance, tokenomics, and infrastructure integration.
About the role
Key Responsibilities
- Develop and maintain systems for measuring, monitoring, and optimizing token throughput.
- Integrate partner and first-party compute environments into OpenAI's infrastructure.
- Design and implement tooling for GPU capacity onboarding, measurement, and optimization.
- Work on performance benchmarking and tokenomics for large-scale infrastructure.
- Contribute to model porting and systems tooling for operational monitoring.
- Ensure GPU capacity is effectively utilized against real workload outcomes.
Requirements
- Experience in building and managing large-scale infrastructure systems.
- Proficiency in performance benchmarking and system monitoring.
- Familiarity with GPU infrastructure and its optimization.
- Strong software engineering skills with a focus on system design.
- Ability to develop robust tooling for infrastructure management.