Search suggestions:

hiring immediately
part time
full time
warehouse
receptionist
summer
server
work from home
manager
marketing
remote
remote work from home
delivery driver
New York
Los Angeles County
Texas
Florida
Houston County
California
Massachusetts
Dallas County
Austin County
Phoenix
Montgomery County
Alabama
Apply

English LLM Evaluator- AI Output Review

Appen
$37,535 - $49,100 a year
Remote
Part time
3 weeks ago
Join Project Hermes 2.0, a global initiative focused on enhancing LLM output across a range of domains!

We’re looking for contributors to take part in a fast-paced evaluation task. In this role, you'll review pairs of inputs and AI-generated outputs, then assess the quality of those outputs based on accuracy, relevance, and clarity—following the project’s established guidelines. Your evaluations will directly support improvements to model performance and help shape the future of responsible AI development.

Key Responsibilities:

  • Review input-output pairs, assessing AI-generated responses for quality and accuracy
  • Evaluate content based on criteria such as clarity, tone, relevance, and alignment with intent
  • Provide structured responses to evaluation questions to support model improvement
  • Maintain high attention to detail and quality across all assigned tasks

Requirements:

  • Native or near-native fluency in English
  • Strong reading comprehension and writing skills
  • Minimum commitment of 20 hours per week
  • Bachelor’s degree or relevant work experience in content evaluation, writing, linguistics, or a related field
  • High attention to detail and ability to follow detailed guidelines
  • Comfortable reviewing content that may include sensitive or potentially harmful material

Slots are filling up fast, and early starters will have the best chance to secure their spot and begin earning sooner!

This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role.
Make an impact on the future of AI – apply today and start contributing from the comfort of your home.
This is a pay-per-unit task, with the pay rate based in USD.
Save Apply
Report job
Other Job Recommendations:

Evaluator Safety Evaluation & Audit Prog

JetBlue
Orlando, Florida
$56,500 - $103,100
  • Identifies, tracks, and solves quality and safety concerns,...
  • Assists and follows up with operational departments in the...
2 weeks ago

DSHS BHHA Psychologist- Forensic Evaluator

State of Washington
Tacoma, Washington
$117,120 - $157,536 a year
Are you interested in the intersection of psychology and the law? Be part of our team that provides answers to psycho-legal...
2 weeks ago

Soccer Evaluator

Westwood Soccer
Norfolk County, Massachusetts
$49 - $51 an hour
As a Soccer Evaluator, you will be responsible for assessing and evaluating soccer players' skills and performance during games...
4 weeks ago

Medical Interpreter -Spanish/English -PRN (As Needed)- On Site - DC

Children's National Hospital
Washington, District of Columbia
$45,614 - $76,024
  • Facilitate communication among patients, families, and staff
  • Set limits appropriately; maintain professional boundaries...
5 days ago

English Language Development (ELD) Teacher - Middle School

Equitas Academy Charter Schools
Los Angeles County, California
  • A strong organizational culture, focused on our mission of...
  • A community that is committed to building and sustaining a...
2 weeks ago