AI Evaluation & Annotation Specialist Entry-Mid Level - Italian Global

Are you curious, detail-oriented, and excited about shaping the future of artificial intelligence?

We’re looking for AI Evaluation & Annotation Specialists to help train and improve Large Language Models (LLMs). In this role, you’ll review AI-generated responses, provide corrections, evaluate quality, and follow structured guidelines to ensure accuracy and consistency.

No engineering background required — if you enjoy problem-solving, analyzing language, and following structured tasks, this role is a great fit.

This is a hands-on, production-based role where accuracy, focus, and consistency matter.

What You’ll Do

• Review AI-generated responses and rate them for clarity, correctness, and relevance.
• Annotate and label content based on project-specific guidelines.
• Follow detailed written instructions and apply them consistently.
• Generate or evaluate prompts depending on assignment type.
• Work with QA Leads to apply feedback and continuously improve task quality.
• Report completed work daily and meet productivity and quality standards.

What Makes You a Strong Fit

• You’re detail-oriented and enjoy accuracy-based work.
• You can follow instructions carefully and apply them consistently.
• You’re comfortable working independently with minimal supervision.
• You have strong reading comprehension and critical thinking skills.
• You communicate clearly and respond to feedback professionally.

Experience with annotation, evaluation, translation, linguistics, or QA is helpful, but not required — training and guidance is provided.

Schedule & Work Expectations

This role is aligned with specific QA and project schedules. You must be available during one of the below time windows depending on your language team:

Language

Shift Window (PST)

9:00 AM to 6:00 PM

• Standard expectation: One consecutive 8-hour shift
• Alternative: Two 4-hour shifts (both must fall fully within the allowed schedule)
• Only logged, approved hours are paid.

This project follows a no paid holidays / no paid time off model.

Location Restrictions

We are unable to accept applicants currently residing in:

Argentina, Bolivia, Brazil, Canada, Chile, China, Colombia, Cuba, Ecuador, Iran, Iraq, North Korea, Mexico, Panama, Russia, Sudan, Syria, Ukraine (Crimea, Luhansk, Donetsk), United Kingdom, Venezuela.

Why Join

✔ Work with a global team

✔ Entry point into the growing AI and language technology industry

✔ Exposure to real-world AI model training

✔ Skill development in annotation, QA/evaluation, and structured AI tasks

This is a strong opportunity for those looking to grow within AI data work, linguistic evaluation,