Software Engineer, AI/ML GenAI - Instrumentl

👋 Hello, we’re Instrumentl . We’re a mission-driven startup helping the nonprofit sector to drive impact, and we’re well on our way to becoming the #1 most-loved grant discovery and management tool.

About us: Instrumentl is a hyper growth YC-backed startup with over 4,000 nonprofit clients, from local homeless shelters to larger organizations like the San Diego Zoo and the University of Alaska. We are building the future of fundraising automation, helping nonprofits to discover, track, and manage grants efficiently through our SaaS platform. Our charts are dramatically up-and-to-the-right 📈 — we’re cash flow positive and doubling year-over-year, with customers who love us (NPS is 65+ and Ellis PMF survey is 60+). Join us on this rocket ship to Mars!

About the Role : As a Software Engineer, AI/ML GenAI at Instrumentl , you’ll own the full lifecycle of AI features—from rapid prototyping to production deployment and ongoing evaluation . You will build agentic LLM systems that can plan and use tools, implement RAG pipelines over our domain data, manage and evolve embeddings , and stand up evaluation/observability so our AI is grounded, safe, and cost‑effective. You’ll embed with one of the product pods in a hands-on role, collaborating closely with Product and Design, while partnering with DTI on platform‑level AI capabilities.

The Instrumentl team is fully distributed (though if you’d like to work from our Oakland office, we would love to see you there). For this position, we are looking for someone who has overlap with Pacific Time Zone working hours.

What you will do

• Design agentic systems & ship AI to production: Build resilient, observable services, while optimizing cost and latency budgets. Build tool‑using LLM “agents” (task planning, function/tool calling, multi‑step workflows, guardrails) for tasks like grant discovery, application drafting, document parsing and many more.
• Own RAG end‑to‑end: Ingest and normalize content, choose chunking/embedding strategies, implement hybrid retrieval, re‑ranking, citations, and grounding. Continuously improve recall/precision.
• Manage embeddings at scale: Select, evaluate, and migrate embedding models; maintain vector stores (e.g., pgvector/Qdrant/Pinecone etc.); monitor drift and rebuild strategies.
• Collaborate cross‑functionally while raising engineering standards: Work side by side with Product, Design on scoping, UX, and measurement; run experiments (A/B, canaries), interpret results, and iterate. Write clear, maintainable code, add tests and docs, and contribute to reliability practices (alerts, dashboards, incident response).

What we're looking for

• Software engineering background: 5+ years of professional software engineering experience (as an IC), including 2+ years working with modern LLMs.
• Proven production impact: You’ve taken LLM/RAG systems from prototype to production,