Ai Response Evaluator - Generalist

Ai Response Evaluator - Generalist

• Contract and Payment Terms
• • You will be engaged as an independent contractor.
  • This is a fully remote role that can be completed on your own schedule.
  • Projects can be extended, shortened, or concluded early depending on needs and performance.

About the Opportunity

We are seeking highly skilled Generalists to support a fast-moving initiative with one of the world’s leading AI labs.

This project focuses on improving AI systems designed for therapeutic-style conversations by evaluating, comparing, and refining model-generated responses.

If you have strong analytical thinking, emotional intelligence, and excellent written communication skills, this role offers a unique opportunity to contribute to the development of safe, supportive, and human-aligned AI systems.

Role Overview

In this position, you will:

• Review and compare pairs of AI-generated responses

• Evaluate responses against structured criteria such as:

  • Empathy

  • Emotional insight

  • Communication quality

  • Appropriateness for supportive dialogue

• Provide clear reasoning for evaluations

• Rewrite responses to better align with therapeutic communication standards

• Support research teams in improving AI behavior in mental-health-oriented conversational settings

Your contributions will directly impact the refinement of AI systems designed for safe and supportive human interaction.

Minimum Qualifications

• Bachelor’s degree (required)

• Strong written English communication skills

• High emotional intelligence and sound judgment

• Ability to follow structured evaluation frameworks

• Comfort working with sensitive or emotionally nuanced content

• Ability to start immediately after onboarding

Preferred Qualifications

• Background in psychology, counseling, social sciences, humanities, or communications

• Experience in content evaluation, moderation, research, or QA

• Experience working with AI systems or language models