onsite
Senior Backend Engineer- AI Agent - Shanghai Xiaoxi
Backend Engineer
Senior Backend Engineer focused on architecting scalable, agentic services and real‑time messaging for AI‑powered products, leveraging Python, Node.js, AWS, and container orchestration.
About the role
Key Responsibilities
- Design and build distributed backend systems that support web, mobile, and multi‑platform AI agents.
- Develop and optimize the agent runtime core, including reasoning loops, tool‑use frameworks, and multi‑step orchestration.
- Own real‑time messaging infrastructure: WebSocket, event‑driven patterns, and pub/sub for high throughput and low latency.
- Integrate and route LLMs across multiple providers (Claude, GPT, Gemini, open‑source) with efficient function calling and memory retrieval.
- Collaborate with cross‑functional teams to define architecture, performance benchmarks, and deployment pipelines.
Requirements
- 5+ years of backend engineering experience with Python and Node.js.
- Strong background in distributed systems, event‑driven architecture, and real‑time communication.
- Hands‑on experience with AWS services, Docker, and Kubernetes for scalable deployments.
- Proficiency in WebSocket, gRPC, and pub/sub patterns.
- Experience optimizing LLM integrations and multi‑provider routing.
Skills
pythonnodejsawsdockerkubernetes