We’re building agentic AI for real-world CX. As an AI Engineer at HiO, you’ll craft scalable, low-latency AI systems - from LLM orchestration to real-time APIs - using Python, LangGraph, and modern cloud stacks. Fast-paced, high-impact, and deeply hands-on.
What you’ll do
- Design, build, and maintain real-time AI-powered APIs and services in Python.
- Architect, optimize, and deploy LLM workflows leveraging LangGraph or similar orchestration frameworks.
- Develop agentic logic and reasoning pipelines for conversational and task-based automation.
- Build scalable infrastructure to support multi-model, low-latency, and streaming AI experiences.
- Collaborate with backend and product teams to translate complex customer workflows into reliable AI systems.
- Ensure high performance, reliability, and data security across production workloads.
- Deploy and manage applications on modern cloud environments (AWS / GCP)
- Implement monitoring, logging, and fault-tolerance mechanisms for production-grade AI systems.
- Contribute to architectural and product decisions, balancing innovation, safety, and scalability.
What We’re Looking For
- BSc or higher in Computer Science, Engineering, or a related technical field.
- 5+ years of experience in backend or ML engineering, building AI/LLM-based systems in production.
- Deep experience with Python (async, multiprocessing, decorators, type hints, debugging).
- Proven hands-on work with LLMs, including streaming inference, prompt management, or multi-agent systems.
- Familiarity with LangGraph, LangChain, or similar orchestration frameworks.
- Strong understanding of MLOps, microservices, and distributed architectures.
- Solid grasp of SQL/NoSQL databases, message queues, and scalable data design.
- Experience deploying applications to AWS, GCP, or similar cloud platforms.
- Ownership mindset - comfortable operating across the stack and figuring things out fast.
- Excited to work in a fast-paced startup environment where priorities shift quickly and impact is immediate.
Originally posted on Himalayas