Note: The job is a remote job and is open to candidates in USA. Rex.zone is seeking a Remote AI Research professional to support end-to-end research and applied experimentation for modern AI systems. The role involves designing experiments, defining evaluation protocols, and improving evaluation rigor through robust measurement and QA evaluation workflows.

Responsibilities

• Develop and run AI research experiments across NLP, computer vision, and multimodal settings
• Design evaluation harnesses for large language model evaluation, including offline/online metrics
• Define RLHF and preference modeling evaluation protocols (rubrics, sampling plans, inter-rater reliability)
• Partner with data labeling teams to improve training data quality and annotation guidelines compliance
• Perform error analysis, ablation studies, and prompt evaluation to identify failure modes
• Build reproducible pipelines for dataset curation, data labeling audits, and QA evaluation
• Translate research findings into engineering-ready requirements and measurable acceptance criteria
• Support content safety labeling strategy and risk analysis for model outputs

Skills

• AI research and machine learning research fundamentals
• Experience with large language models and model evaluation
• Hands-on RLHF concepts (preference data, reward modeling, evaluation)
• Strong experiment design and statistics basics
• Familiarity with training data quality practices and dataset documentation
• NLP and/or computer vision domain knowledge
• Ability to collaborate cross-functionally with engineering and data operations

Company Overview

• RemoExperts is a global platform where skilled professionals and tutors contribute to AI training across video, image, audio, text, code, math, and more. It was founded in 2025, and is headquartered in Palo Alto, California, US, with a workforce of 201-500 employees. Its website is https://www.remoexperts.com.