remote
Staff Software Engineer, Inference - CoreWeave Europe
Software Engineer
Staff Software Engineer specializing in inference systems for AI. This role involves developing and optimizing high-performance, scalable inference solutions on cloud infrastructure, leveraging expertise in Python, C++, and distributed systems.
About the role
Key Responsibilities
- Design, develop, and deploy scalable and efficient inference systems for AI models.
- Optimize inference performance and resource utilization on cloud infrastructure.
- Collaborate with ML engineers and researchers to integrate and deploy models.
- Build and maintain robust, production-ready software for AI inference.
- Troubleshoot and resolve complex issues in distributed inference environments.
- Contribute to the architecture and evolution of CoreWeave's AI cloud platform.
Requirements
- Proven experience in software engineering, with a focus on distributed systems and high-performance computing.
- Strong proficiency in Python and C++.
- Experience with cloud platforms (e.g., AWS, GCP, Azure) and containerization technologies (e.g., Kubernetes).
- Familiarity with machine learning frameworks and inference optimization techniques.
- Excellent problem-solving and debugging skills.
Skills
pythoncdistributed systemsmachine learningcloud computingkubernetes