Note: The job is a remote job and is open to candidates in USA. Prolific is building the biggest pool of quality human data in the world, and they are seeking Concierges to help train and evaluate cutting-edge AI models. The role involves reviewing AI-generated responses and providing feedback to improve model performance.

Responsibilities

• Reviewing AI-generated responses to scenarios a Concierge would face and rating them for accuracy, appropriateness, safety, and reasoning quality
• Comparing multiple model answers and selecting/justifying the best response
• Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short

Skills

• Verified status as a Concierge (e.g., by providing a professional profile that shows both educational and professional experience)
• Recent clinical experience and comfort evaluating clinical reasoning and decision-making
• Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
• Strong attention to detail and the ability to focus on complex tasks for up to one hour
• A reliable, fast internet connection and access to a computer
• Willingness to self-declare earnings (participants are self-employed)
• A PayPal account to receive payments from our clients

Benefits

• Competitive pay rates
• Flexible hours
• The ability to work from home

Company Overview

Company H1B Sponsorship