Software Engineer
Hume AI is looking for a systems-oriented engineer to own the path from trained model to production inference.
Hume AI is looking for a systems-oriented engineer to own the path from trained model to production inference. Join us in the heart of New York City and contribute to our endeavor to ensure that AI is guided by human values, the most pivotal challenge—and opportunity—of the 21st century.
About the Role
As the first engineer dedicated full-time to inference backends at Hume, you will own the systems that take trained models from checkpoints to production inference: graph export, engine compilation, runtime integration, serving contracts, client libraries, artifact verification, and the performance and correctness of what runs in production.
You will work closely with research scientists, machine learning engineers, backend engineers, and the Data Plane team to bring new models and inference capabilities into production.
This is a systems-oriented role focused on performance, numerical correctness, reliability, and efficient use of accelerators. You will operate with a high degree of autonomy, make sound architectural decisions, and own systems throughout their lifecycle—from initial design and implementation through deployment, observability, optimization, and production support.
About the Role
As the first engineer dedicated full-time to inference backends at Hume, you will own the systems that take trained models from checkpoints to production inference. This includes graph export, engine compilation, runtime integration, serving contracts, artifact verification, and production performance and correctness.
You will also own Hume’s internal inference platform, which serves many of our in-house models across products. This includes deployment, routing, load balancing, health checking, observability, capacity management, and safe model rollout.
You will work closely with research scientists, machine learning engineers, backend engineers, and product teams to turn new model capabilities into reliable production systems.
This is a systems-oriented role focused on performance, numerical correctness, reliability, and efficient use of accelerators. You will operate with a high degree of autonomy and own systems from design through production.
What You’ll Do
Own the path from trained checkpoint to served request, including graph export, engine compilation, runtime integration, and serving configuration.
Build and evolve Hume’s internal inference platform for serving multiple models across products and workloads.
Design and operate serving infrastructure, including routing, load balancing, health checking, autoscaling, capacity management, and failure handling.
Build reproducible, versioned inference artifacts and tooling for validation, deployment, promotion, and rollback.
Build verification gates that catch numerical, behavioral, and performance regressions before production.
Posted September 17, 2026