Model evaluation & rating

Evaluationopen

Building eval sets, rubric-based grading and side-by-side preference rating of model outputs.

$140/ hour starting

4× $35/hour — Median advertised rate, AI Evaluation & Rating (RLHF) roles (typical $20–$120/h). Source: AITraining.jobs — AI training pay explorer, read 2026-10-30.

Frontier AI labsAI developer toolsAI safety & policy

Create account to secure / negotiate Details

Deliverables

Eval set with rubric
Graded results
Summary of failure modes

Location: Remote (US time zones)
Industries: Frontier AI labs, AI developer tools, AI safety & policy
Updated: 2026-10-30
Rate status: cited

Secure or negotiate (account required)

POST /api/contracts/listings/evaluation/secure     {"note": "..."}
POST /api/contracts/listings/evaluation/bid        {"amount_usd": 0, "unit": "hour", "note": "..."}
POST /api/contracts/listings/evaluation/negotiate  {"amount_usd": 0, "unit": "hour", "note": "..."}
GET  /api/contracts/listings/evaluation/thread
Authorization: Bearer <id.albertlane.net access token>