LLM QA Contractor - jobgether

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a LLM QA Contractor based in India.

This is a remote freelance opportunity for a detail-oriented professional supporting an AI validation project focused on improving the quality and reliability of Large Language Model (LLM) outputs. The role involves reviewing AI-generated responses by comparing them against images, instructions, and quality standards to ensure accuracy and consistency. You will play an important role in identifying errors, improving model performance, and contributing to safer AI-powered experiences. The position requires strong analytical thinking, attention to detail, and the ability to follow structured review processes. You will collaborate within a quality-focused environment while working independently through digital annotation tools and workflows. This opportunity is ideal for candidates interested in AI, data quality, content evaluation, and the future of intelligent technologies.

Accountabilities:

The LLM QA Contractor will be responsible for evaluating AI outputs and providing structured feedback to support continuous improvement of AI systems. Key responsibilities include:

• Reviewing AI-generated responses against source images, delivery instructions, and established quality guidelines.
• Verifying factual accuracy, completeness, relevance, and alignment with expected outcomes.
• Identifying and categorizing issues such as hallucinations, missing details, incorrect interpretations, or policy concerns.
• Providing clear and concise feedback to improve model performance and output quality.
• Following Standard Operating Procedures (SOPs), participating in calibration sessions, and maintaining consistency across evaluations.
• Managing review activities through annotation platforms, spreadsheets, and other web-based tools.
• Escalating unclear cases, guideline gaps, or complex scenarios when required.
• Consistently achieving quality, accuracy, and productivity targets within required timelines.

Requirements:

The ideal candidate has experience in quality assurance, content evaluation, or data-focused roles and demonstrates strong analytical and communication skills. Required qualifications and skills include:

• Strong attention to detail with a structured and analytical approach to reviewing information.
• Previous experience in Content QA, Data Labeling, Trust & Safety, Content Moderation, or similar quality assurance roles.
• Excellent visual analysis skills and strong reading comprehension abilities.
• Comfortable using web-based tools, spreadsheets, and annotation platforms.
• Ability to manage repetitive tasks while maintaining accuracy and consistency.
• Strong written communication skills in English.