English LLM Evaluator- AI Output Review

Appen
$37,535 - $49,100 a year
Remote
Part time
2 weeks ago
Join Project Hermes 2.0, a global initiative focused on enhancing LLM output across a range of domains!

We’re looking for contributors to take part in a fast-paced evaluation task. In this role, you'll review pairs of inputs and AI-generated outputs, then assess the quality of those outputs based on accuracy, relevance, and clarity—following the project’s established guidelines. Your evaluations will directly support improvements to model performance and help shape the future of responsible AI development.

Key Responsibilities:

  • Review input-output pairs, assessing AI-generated responses for quality and accuracy
  • Evaluate content based on criteria such as clarity, tone, relevance, and alignment with intent
  • Provide structured responses to evaluation questions to support model improvement
  • Maintain high attention to detail and quality across all assigned tasks

Requirements:

  • Native or near-native fluency in English
  • Strong reading comprehension and writing skills
  • Minimum commitment of 20 hours per week
  • Bachelor’s degree or relevant work experience in content evaluation, writing, linguistics, or a related field
  • High attention to detail and ability to follow detailed guidelines
  • Comfortable reviewing content that may include sensitive or potentially harmful material

Slots are filling up fast, and early starters will have the best chance to secure their spot and begin earning sooner!

This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role.
Make an impact on the future of AI – apply today and start contributing from the comfort of your home.
This is a pay-per-unit task, with the pay rate based in USD.
Apply
Other Job Recommendations:

Evaluator Safety Evaluation & Audit Prog

JetBlue
Orlando, Florida
$56,500 - $103,100
  • Identifies, tracks, and solves quality and safety concerns,...
  • Assists and follows up with operational departments in the...
1 week ago

DSHS BHHA Psychologist- Forensic Evaluator

State of Washington
Tacoma, Washington
$117,120 - $157,536 a year
Are you interested in the intersection of psychology and the law? Be part of our team that provides answers to psycho-legal...
1 week ago

Soccer Evaluator

Westwood Soccer
Norfolk County, Massachusetts
$49 - $51 an hour
As a Soccer Evaluator, you will be responsible for assessing and evaluating soccer players' skills and performance during games...
2 weeks ago

Admissions Evaluator

Regent University
Virginia Beach, Virginia
$45,898 - $56,715 a year
  • Review and evaluate application files for admissions...
  • Maintain working knowledge on programmatic content, helpful...
3 weeks ago

Certified Rehabilitation Counselor/Vocational Evaluator

Vocational Consulting for Oklahoma, LLC
Norman, Oklahoma
  • Advanced degree in vocational rehabilitation, psychology,...
  • Must have a current and valid Certified Rehabilitation...
4 weeks ago