Chemistry (PhD) Expert - Ai Training Evaluation

Engagement Type: Independent Contractor
Work Mode: Fully Remote
Schedule: Flexible (Project-Based)

Role Overview

We partner with leading AI teams to improve the quality, usefulness, and reliability of conversational AI systems.

In chemistry-related contexts, AI systems must demonstrate:

• Accurate mechanistic reasoning

• Quantitative precision

• Strong command of chemical theory and application

This role focuses on evaluating and improving how AI models reason about, explain, and communicate chemistry concepts across foundational and advanced topics.

Key Responsibilities

• Write and refine prompts to guide AI model behavior in chemistry contexts

• Evaluate AI-generated responses for:

  • Scientific accuracy

  • Mechanistic correctness

  • Quantitative reasoning

• Conduct fact-checking using authoritative sources and domain expertise

• Annotate responses by identifying:

  • Strengths

  • Weak reasoning

  • Conceptual inaccuracies

• Assess explanation clarity and structure for different audience levels

• Ensure responses align with conversational guidelines and evaluation standards

• Apply structured taxonomies, benchmarks, and detailed review frameworks

Required Qualifications

• PhD in Chemistry or a closely related field

Deep expertise in one or more of the following domains:

• Organic & Biological Chemistry

• Inorganic & Materials Chemistry

• Physical & Theoretical Chemistry

• Analytical & Instrumental Chemistry

Additional Requirements:

• Significant experience using large language models (LLMs)

• Strong understanding of how LLMs are used and where they fail

• Excellent technical writing and explanation skills

• Exceptional attention to detail

• Experience reviewing or editing academic or technical writing

Nice-to-Have Qualifications

• Experience with RLHF, AI model evaluation, or data annotation

• Teaching or mentoring experience

• Familiarity with structured evaluation rubrics or benchmarking systems

What Success Looks Like

• You identify subtle inaccuracies or weak reasoning in chemistry outputs

• Your feedback improves scientific rigor and clarity

• You deliver reproducible evaluation artifacts

• AI systems become more reliable in chemistry-related applications

Why Join

• Apply PhD-level expertise to frontier AI development

• Contribute to high-impact AI research beyond traditional academic roles

• Flexible schedule with project-based autonomy

• Competitive compensation aligned with expertise

Contract & Payment Terms

• Independent Contractor engagement

• Fully remote with flexible working schedule

• Project-based work (may be extended or concluded based on needs and performance)

• Weekly payments via Stripe or Wise

• Unable to support H1-B or STEM OPT candidates at this time