Search suggestions:

hiring immediately
part time
full time
summer
front desk
work from home customer service
receptionist
medical receptionist
warehouse
remote
remote work from home
restaurant
work from home
Wichita
United States
Houston
Dallas
Oklahoma City
Remote
Kansas City
San Antonio
Shreveport
New York
Tulsa
Chicago
Irving
Seattle
Denver
Apply

English LLM Evaluator- AI Output Review

Appen
$37,535 - $49,100 a year
Remote
Part time
5 days ago
Join Project Hermes 2.0, a global initiative focused on enhancing LLM output across a range of domains!

We’re looking for contributors to take part in a fast-paced evaluation task. In this role, you'll review pairs of inputs and AI-generated outputs, then assess the quality of those outputs based on accuracy, relevance, and clarity—following the project’s established guidelines. Your evaluations will directly support improvements to model performance and help shape the future of responsible AI development.

Key Responsibilities:

  • Review input-output pairs, assessing AI-generated responses for quality and accuracy
  • Evaluate content based on criteria such as clarity, tone, relevance, and alignment with intent
  • Provide structured responses to evaluation questions to support model improvement
  • Maintain high attention to detail and quality across all assigned tasks

Requirements:

  • Native or near-native fluency in English
  • Strong reading comprehension and writing skills
  • Minimum commitment of 20 hours per week
  • Bachelor’s degree or relevant work experience in content evaluation, writing, linguistics, or a related field
  • High attention to detail and ability to follow detailed guidelines
  • Comfortable reviewing content that may include sensitive or potentially harmful material

Slots are filling up fast, and early starters will have the best chance to secure their spot and begin earning sooner!

This role is a project-based opportunity with CrowdGen, where you will join the CrowdGen Community as an Independent Contractor. If selected, you will receive an email from CrowdGen regarding the creation of an account using your application email address. You will need to log in to this account and reset the password, complete the setup requirements, and proceed with your application for this project-based role.
Make an impact on the future of AI – apply today and start contributing from the comfort of your home.
This is a pay-per-unit task, with the pay rate based in USD.
Save Apply
Report job
Other Job Recommendations:

Global LLM Data - LLM Training Operation Coding Analyst

ByteDance
Los Angeles County, California
$92,000 - $200,000
This role focuses on overseeing and improving operational workflows, primarily for code-related projects, ensuring they are...
3 weeks ago

Soccer Evaluator

Westwood Soccer
Norfolk County, Massachusetts
$49 - $51 an hour
As a Soccer Evaluator, you will be responsible for assessing and evaluating soccer players' skills and performance during games...
1 week ago

DSHS BHHA Psychologist- Forensic Evaluator

State of Washington
Washington
$108,252 - $144,536 a year
Are you interested in the intersection of psychology and the law? Be part of our team that provides answers to psycho-legal...
2 weeks ago

Admissions Evaluator

Regent University
Virginia Beach, Virginia
$45,898 - $56,715 a year
  • Review and evaluate application files for admissions...
  • Maintain working knowledge on programmatic content, helpful...
2 weeks ago

Certified Rehabilitation Counselor/Vocational Evaluator

Vocational Consulting for Oklahoma, LLC
Norman, Oklahoma
  • Advanced degree in vocational rehabilitation, psychology,...
  • Must have a current and valid Certified Rehabilitation...
2 weeks ago