Senior Software Engineer, Evals and AI Infra

About the Role

At Commure, our Ambient AI team is at the forefront of revolutionizing healthcare technology by building AI solutions that span the entire care journey, from the patient visit to the final claim. You'll work across real-time clinical documentation powered by LLMs, AI-driven billing automation that improves revenue capture and reduces denials, and a clinical intelligence platform that grounds answers in live patient context. If you love working on important, exciting problems in healthcare and love shipping quickly, come join us!

What You’ll Do

• Contribute to the most advanced healthcare platform in the country
• Help scale infrastructure that supports the largest health systems in the country
• Be a part of a tremendously fast-paced team that celebrates fast execution and decisions
• Design eval and AI pipelines that are reliable, reproducible, and extendable
• Shape model interactions by partnering with engineering and product teams on how models are deployed and measured
• Work with a stack that includes Python, Flask, Django, FastAPIs and other frameworks
• Work directly with customers to solve their issues daily

What You Have

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent extensive experience
• Professional software development industry experience
• Strong Backend Programming Skills (Must be comfortable with Python)
• Experience in environments where you have to ship quickly. We move fast.
• Have experience building AI applications, including designing evals and improving performance through prompting or scaffolding
• Are familiar with evaluation methods for LLMs and have worked with patterns like multi-agent workflows, tool use, or long context.
• General Understanding of Containers and Cloud (Docker, Kubernetes)
• Excitement to work in a high impact field with a builder attitude!
• Extremely motivated to grow
• Strong leadership skills