Evaluation Jobs

98 jobs from companies building with AI · Avg salary $249k (57 with data)

AI evaluation engineering roles focused on benchmarking, testing, and measuring model performance. Evaluation engineers build the frameworks that determine whether AI systems are improving.

Using an AI agent? Choose a role, then see a free evidence map and job-specific draft from your existing truthful experience. Candidate charge $0; you approve each exact application.

Senior Product Operations Manager, Evaluation

Harvey AI · San Francisco, CA
agents evaluation
Remote full-time senior 2 months ago

AI Quality & Evaluation Engineer, AI product

Woven by Toyota · Tokyo, Japan
autonomous-vehicles evaluation infrastructure
On-site full-time mid 2 months ago

Engineering Manager, Evals

Cursor · San Francisco, CA
search evaluation
On-site full-time mid 2 months ago

Manager I, Engineering - AI Platform - Evaluation & Annotation

Datadog · Paris, France
data-pipeline llm evaluation
Hybrid full-time lead 2 months ago

Member of Engineering (Evaluations)

Poolside · Remote (Europe)
llm evaluation research
Remote full-time lead 4 months ago

Software Engineer, Agent Evaluation and Quality

Cursor · San Francisco, CA
search evaluation
On-site full-time mid 4 months ago

Director of Engineering, Eval Platform

Nuro · Mountain View, CA
autonomous-vehicles robotics evaluation
On-site full-time lead 6 months ago

Researcher, Evals

Cartesia AI · San Francisco, CA
generative-ai research evaluation
On-site full-time mid 10 months ago

Machine Translation Evaluation – English <> Ukrainian; Project Vistula

Appen · Ukraine
evaluation
Remote contract mid 1 month ago

Machine Translation Evaluation – English <> Swedish; Project Vistula

Appen · Sweden
evaluation
Remote contract mid 1 month ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Machine Translation Evaluation – English to Spanish (Spain); Project Vistula

Appen · Spain
evaluation
Remote contract mid 1 month ago

Machine Translation Evaluation – English <> Polish; Project Vistula

Appen · Poland
evaluation
Remote contract mid 1 month ago

Machine Translation Evaluation – English <> Italian; Project Vistula

Appen · Italy
evaluation
Remote contract mid 1 month ago

Machine Translation Evaluation – English <> Hungarian; Project Vistula

Appen · Hungary
evaluation
Remote contract mid 1 month ago

Machine Translation Evaluation – English to Hebrew; Project Vistula

Appen · Israel
evaluation
Remote contract mid 1 month ago

Machine Translation Evaluation – English <> German; Project Vistula

Appen · Germany
evaluation
Remote contract mid 1 month ago

Machine Translation Evaluation – English <> Dutch; Project Vistula

Appen · Netherlands
evaluation
Remote contract mid 1 month ago

Translation Evaluator – Russian/English (Remote)

Appen · Any
evaluation
Remote contract mid 2 months ago

Weekly AI Jobs Digest

Top new roles from 56+ companies. Curated, not scraped. One email, every Monday.

No spam. Unsubscribe anytime.

Hiring AI engineers?

Post the role first. Your company profile and analytics connect from the employer flow.

Post a Job See Pricing

Agentic API & MCP Server

Wire AI Dev Jobs into your agent at build time — MCP server live, REST API public for discovery, free API keys for recurring search.

# Add as MCP server
claude mcp add --transport http aidevjobs https://aidevboard.com/mcp

# Or hit the REST API
curl https://aidevboard.com/api/v1/jobs?tags=llm,pytorch

13 tools via com.aidevboard/jobs · Open read access · optional free keys for stable agent identity