Skip to main content

Research Engineer, Post-Training Model Evaluations

L5

prof rodMillbrae, CAyesterday
Research Engineer, Post-Training Model Evaluations Investigate model quality during production post-training, maintain evaluation coverage and explain regressions to research teams. Vacancy announcement Who this suits: Individual qualified applicant Accepting applications has not been verified separately from the announcement. USD 500,000–850,000/year (salary; 2026-10-05). Published annual salary range; employer determines level. What the institution asks for Experience designing and analyzing ML evaluations at scale; strong Python and production-system skills. Statistics and experimental design are additional strengths. Bachelor's degree or equivalent experience; office attendance expected. ProfRod's suggested preparation Understand what this work involves Practice the paired comparisons used to investigate changes in post-training evaluation results. Predict the difference before recomputing the saved results. Name the sampling unit, interval and one limit; keep the notebook output with your memo.
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

SeniorL5

Location

Millbrae, CA

Occupation

Data Scientists

Industry

Other Scientific and Technical Consulting Services

Posted

yesterday

To get sharper similar jobs, create your profile using the link below.

Create profile