Evaluation Jobs

92 jobs from companies building with AI · Avg salary $239k (44 with data)

AI evaluation engineering roles focused on benchmarking, testing, and measuring model performance. Evaluation engineers build the frameworks that determine whether AI systems are improving.

Director of Engineering, Eval Platform

Nuro · Mountain View, CA
autonomous-vehicles robotics evaluation
On-site full-time lead 3 months ago

French Search Ads Evaluator (Canada)

Appen · Canada
search evaluation
Remote contract mid 3 months ago

Researcher, Evals

Cartesia AI · San Francisco, CA
generative-ai evaluation research
On-site full-time mid 7 months ago

Machine Translation Evaluation – Chinese (Traditional) to English; Project Vistula 2026

Appen · Any
evaluation
Remote contract mid 3 weeks ago

Machine Translation Evaluation – Chinese (Simplified) to English; Project Vistula 2026

Appen · Any
evaluation
Remote contract mid 3 weeks ago

Machine Translation Evaluation – Korean to English; Project Vistula 2026

Appen · Any
evaluation
Remote contract mid 3 weeks ago

Legal & Compliance AI Rater/Evaluator

LILT · Remote
mlops evaluation
Remote contract mid 1 month ago

Healthcare & Life Sciences AI Rater & Evaluator

LILT · Remote
healthcare mlops evaluation
Remote contract mid 1 month ago

Finance & Investment AI Rater/Evaluator

LILT · Remote
mlops evaluation
Remote contract mid 1 month ago

Educational Technology AI Rater & Evaluator

LILT · Remote
mlops evaluation
Remote contract mid 1 month ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Customer Service & Support AI Rater & Evaluator

LILT · Remote
mlops evaluation
Remote contract mid 1 month ago

Consumer Goods & Retail AI Rater & Evaluator

LILT · Remote
mlops evaluation
Remote contract mid 1 month ago

Weekly AI Jobs Digest

Top new roles from 50+ companies. Curated, not scraped. One email, every Monday.

No spam. Unsubscribe anytime.

Hiring AI engineers?

Post the role first. Your company profile and analytics connect from the employer flow.

Post a Job See Pricing

Agentic API & MCP Server

Wire AI Dev Jobs into your agent at build time — MCP server live, REST API public for discovery, free API keys for recurring search.

# Add as MCP server
claude mcp add --transport http aidevjobs https://aidevboard.com/mcp

# Or hit the REST API
curl https://aidevboard.com/api/v1/jobs?tags=llm,pytorch

13 tools via com.aidevboard/jobs · Free keyed access · Pro $49/mo →