AI Safety Specialist - Evaluation Expert in San Francisco
$60–$70/hour
Apply now (opens in a new tab)AI Safety Specialist - Evaluation Expert in San Francisco
L5
$60–$70/hour
Industries
Other Scientific and Technical Consulting ServicesAll Other Professional, Scientific, and Technical ServicesOther Management Consulting Services- Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark
- General Catalyst
- Peter ThielAdam D'AngeloLarry Summers, and Jack Dorsey
- RemoteRole Responsibilities
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
- Apply and refine evaluation rubrics for RLHFSFT, and AI safety benchmarking
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations.
- Provide structured feedback to improve model alignment and safety performance.
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives.
- (Takes 20–30 mins to complete)
- Upload resumeAI interview based on your resume
- Submit form
- Resources & Support
Level
SeniorL5
Salary
$60–$70/hour
Location
Millbrae, CA
Occupation
Information Security Analysts
Industry
Other Scientific and Technical Consulting Services
Posted
yesterday
To get sharper similar jobs, create your profile using the link below.