Software Engineer, Applied AI

About the Company

Rilla is a foundational company on a mission to index the offline world. They have built the leading sales coaching software for organizations doing sales offline, serving over 1000 customers including The Home Depot and KKR. Rilla is backed by Google Ventures, Bessemer Ventures, Crew Capital, and Broom Ventures. They are an in-office team in NYC, valuing customer obsession, high velocity, and real-world impact. The company aims to build products and systems for capturing and indexing billions of real-world conversations.

The Role

The Applied AI team at Rilla is focused on redefining human-machine interaction through voice, intelligence, and new classes of data. As a Software Engineer on this team, you will be responsible for architecting and shipping AI-powered systems that enable natural language interaction with Rilla. This involves building agents that operate on real-world audio, extracting unique insights from conversations, and pushing the boundaries of AI capabilities.

Key projects include:

• A voice-first interface for commanding Rilla directly through natural speech.
• A search engine to uncover business-critical insights from previously unsearchable voice data.
• A first-of-its-kind audio intelligence pipeline designed for messy, noisy, unstructured real-world conversations.

As an early AI engineer, you will play a crucial role in shaping the foundations of the AI stack and driving the invention of new techniques, tooling, and models. The role spans the full AI lifecycle, from data acquisition to real-time inference and user-facing chat interfaces.

Technologies We Use

• Primary languages: Python and TypeScript
• API development: FastAPI
• AI/ML technologies: PyTorch, OpenAI APIs, Baseten, LiteLLM
• Cloud infrastructure: AWS
• Real-time communications: LiveKit
• Data storage: PostgreSQL, Redis, S3

What We Require

• Experience building and deploying AI/LLM systems in production.
• Familiarity with tools that power today's AI, including eval frameworks, agent tooling, and prompt engineering.
• Comfort working directly with customers to understand their needs and solve real-world problems.

What We Value

• An infinite learner with relentless curiosity.
• A customer obsessive who deeply cares about delighting customers and solving real pains.
• A winning attitude, thriving with extreme accountability, team learning, and rapid feedback.
• Extreme empathy for customers who work in the real world, not just tech companies.
• Unafraid of failure, seeing it as an opportunity to learn, grow, and improve.

Benefits

• Medical, dental, and vision insurance
• Breakfast, lunch, dinner, and supplementary food and drink
• Gym membership
• Commuter benefits
• Relocation assistance
• Take what you need paid time off (not accrual based)
• $1,000 stipend for learning and personal growth
• $1,500 a month rent stipend
• Tech equipment