remote
Staff Software Engineer, Inference - CoreWeave
Software Engineer
Staff Software Engineer specializing in inference at CoreWeave, a cloud provider for AI. Focus on building and scaling AI infrastructure using Python, C++, and distributed systems.
About the role
Key Responsibilities
- Design, develop, and deploy scalable inference systems for AI workloads.
- Optimize performance of machine learning models for high-throughput inference.
- Collaborate with research and engineering teams to integrate new AI models and technologies.
- Build and maintain robust, fault-tolerant distributed systems.
- Contribute to the development of CoreWeave's AI cloud platform.
- Troubleshoot and resolve complex technical issues in production environments.
Requirements
- Proven experience as a Software Engineer with a focus on inference systems.
- Strong programming skills in Python and C++.
- Deep understanding of distributed systems and cloud computing principles.
- Experience with machine learning frameworks and deployment strategies.
- Familiarity with containerization technologies like Kubernetes.
Skills
pythoncdistributed systemsmachine learningkubernetescloud computing