remoteonsite
Staff Software Engineer - AI Traffic & Inference Infrastructure - Coupang Internal
Software Engineer
Staff Software Engineer sought to build and optimize AI traffic and inference infrastructure. Requires expertise in Python, machine learning, and distributed systems for high-performance solutions.
About the role
Key Responsibilities
- Design, develop, and maintain scalable infrastructure for AI model inference and traffic management.
- Optimize system performance for low latency and high throughput in AI workloads.
- Collaborate with ML engineers and researchers to integrate and deploy AI models efficiently.
- Develop robust monitoring and alerting systems for inference infrastructure.
- Contribute to the architectural roadmap for AI infrastructure.
- Troubleshoot and resolve complex issues in production environments.
Requirements
- Proven experience in building and managing large-scale distributed systems.
- Strong programming skills in Python and experience with ML frameworks.
- Deep understanding of cloud computing platforms and infrastructure as code.
- Experience with AI inference optimization techniques and tools.
- Excellent problem-solving and debugging abilities.
Skills
pythonmachine learningdistributed systemscloud computinginfrastructureai