onsite
Software Engineer, Inference Platform
Software Engineer
Software Engineer focused on building and maintaining a high‑performance inference platform, leveraging C++ and Go to develop scalable distributed services, while ensuring robust CI/CD pipelines and meticulous debugging practices.
About the role
Key Responsibilities
- Design, implement, and optimize inference services in C++ for low‑latency, high‑throughput workloads.
- Develop and maintain Go‑based microservices that orchestrate model deployment and scaling across distributed clusters.
- Engineer and refine CI/CD pipelines to automate build, test, and deployment processes, ensuring rapid and reliable releases.
- Diagnose and resolve complex performance and reliability issues in production, using advanced debugging and profiling tools.
- Collaborate with data scientists and product teams to translate model specifications into production‑ready code.
- Document architecture, design decisions, and operational procedures for internal knowledge sharing.
Requirements
- Strong proficiency in C++ (C++17/20) and Go, with a track record of building production‑grade systems.
- Hands‑on experience with CI/CD tooling (Jenkins, GitHub Actions, GitLab CI, or similar) and container orchestration (Kubernetes, Docker).
- Deep understanding of distributed systems concepts, including networking, fault tolerance, and data consistency.
- Excellent debugging skills, capable of troubleshooting complex multi‑service environments.
- Effective communicator who can document technical solutions and mentor junior engineers.