About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Code-Data Eval Author — Software Engineer Type: Contract Compensation: $35–$120/hour Location: Remote Commitment: 30+ hours/week
Role Responsibilities
- Author non-trivial coding tasks with golden solutions and automated verifiers.
- Design rubrics and grade agent trajectories and model outputs.
- Improve task and rubric quality through structured review.
- Evaluate the accuracy and depth of AI-generated content to strengthen reasoning and rigor in model outputs.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of software engineering at a real product organization (big tech or venture-backed startup).
- Strong code quality, systems design, debugging, and testing discipline.
- Clear written communication (you write instructions others follow).
Preferred
- Familiarity with AI coding tools and evals.
Interview Process
- Short Mercor Technical Screen .
- Live Code Review Session .
- Domain Expert Interview .
- You're paid $200 for completing all three, regardless of outcome.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs. mercor .com/welcome
- For any help or support, reach out to: support@ mercor .com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas