We are sharing a specialised part-time consulting opportunity for software engineering and data science professionals experienced in technical documentation, codebases, API references, data workflows, instruction-following evaluation, task authoring, and rubric design.
This role supports current and upcoming remote consulting opportunities focused on professional document understanding, technical task design, workspace-file reasoning, code execution workflows, structured evaluation, and high-quality project execution. Selected professionals will author complex, multi-step tasks grounded in real-world technical materials, define accurate ground truth outputs, and create objective rubrics for evaluating structured responses.
Key Responsibilities
Professionals in this role may contribute to:
Technical Task Authoring
- Design complex, multi-step tasks grounded in real-world technology workspace files
- Create tasks based on technical specifications, architecture documents, API references, codebases, data files, or analytical workflows
- Develop prompts that test precise instruction following, technical reasoning, and structured output generation
- Incorporate realistic requirements involving technical documentation review, web research, or code execution where appropriate
Ground Truth & Rubric Design
- Define clear ground truth outputs for each task
- Build objective evaluation rubrics that assess correctness, completeness, reasoning quality, and formatting
- Identify expected edge cases, common failure modes, and criteria for high-quality responses
- Ensure each task has a clear, reproducible evaluation path
Technical Review & Quality Control
- Review task materials for ambiguity, technical accuracy, and instruction clarity
- Validate that tasks are realistic, challenging, and aligned with professional software or data science workflows
- Check that expected outputs are accurate, well-structured, and defensible
- Maintain consistency, attention to detail, and strong documentation quality across submitted work
Ideal Profile
Strong candidates may have:
- 3+ years of hands-on experience in software engineering, data science, analytics, or a closely related technical field
- Strong ability to understand technical specifications, architecture documents, API documentation, codebases, or data workflows
- Experience writing clear technical instructions, reviewing structured outputs, or designing technical evaluation materials
- Comfort with code execution, debugging, data analysis, and technical reasoning
- Strong written communication skills and ability to define precise evaluation criteria
- High attention to detail and ability to create tasks with clea