Open role
Research Chemist | Up to $73/hr
• *About The Job
- *Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
- *Benchmark ,
- *General Catalyst ,
- *Peter Thiel ,
- *Adam D'Angelo ,
- *Larry Summers , and
- *Jack Dorsey .
- *Position Chemistry AI Evaluator
- *Type
- *Contract
- Compensation
- $73/hour
- *Location
- *Remote
- *Role Responsibilities
- Write and refine prompts to guide model behavior in chemistry contexts.
- Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and quantitative reasoning.
- Conduct fact-checking using authoritative public sources and domain knowledge.
- Annotate model responses by identifying strengths, areas of improvement, and inaccuracies.
- Assess clarity, structure, and appropriateness of explanations for different audiences.
- Apply consistent evaluation standards by following clear taxonomies and benchmarks.
- *Qualifications
- *Must-Have
- PhD in Chemistry or a closely related field
- Deep expertise in Organic & Biological Chemistry, Inorganic & Materials Chemistry, Physical & Theoretical Chemistry, or Analytical & Instrumental Chemistry
- Significant experience using large language models (LLMs)
- Excellent writing skills and strong attention to detail
- Experience reviewing or editing technical or academic writing
- *Preferred
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience teaching or explaining chemistry concepts to non-expert audiences
- Familiarity with evaluation rubrics or structured review frameworks
- *Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
- Resources & Support
- For details about the interview process and platform information, please check https//talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to [email protected]
- PS Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. , Apply To this Job