Note: The job is a remote job and is open to candidates in USA. Rex.zone connects remote contributors with production AI/ML data operations work that supports LLM training pipelines. In this remote, full-time role, you will produce and validate training data used to improve large language model evaluation and downstream model performance.

Responsibilities

• Deliver accurate data labeling aligned to annotation guidelines and project rubrics
• Perform QA evaluation using checklists to catch schema errors, guideline deviations, and low-confidence labels
• Complete prompt evaluation and RLHF tasks by comparing model outputs, ranking responses, and writing short justifications when required
• Maintain consistent training data quality across large batches and escalate edge cases with clear examples
• Track work in project tools, meet throughput targets, and provide well-documented feedback to support model performance improvement

Skills

• Comfort working with structured rubrics, examples, and guideline compliance
• Strong attention to detail for QA evaluation and training data quality checks
• Ability to reason about language and intent for NLP tasks (e.g., NER, classification)
• Basic familiarity with AI/ML concepts such as large language models, RLHF, and evaluation datasets

Company Overview

• RemoExperts is a global platform where skilled professionals and tutors contribute to AI training across video, image, audio, text, code, math, and more. It was founded in 2025, and is headquartered in Palo Alto, California, US, with a workforce of 201-500 employees. Its website is https://www.remoexperts.com.