Contract — AI Agent Evaluation

Aaru · Remote · $100k - $150k

contract mid Posted 4 months ago

Before you apply

Build my evidence-backed draft — free

Paste your relevant resume section or 2–4 true bullets. No generic form is sent; any later submission requires your approval of the exact draft and role.

Get weekly job alerts like this →

evaluation python agents statistics nlp benchmarking

About this role

Evaluate and benchmark Aaru's synthetic research agents. Design evaluation protocols, run A/B tests, and measure agent accuracy against human researchers. 3-month contract with extension possibility. Remote-friendly.

Requirements

Experience with LLM evaluation or user research. Statistical analysis skills. Python. Available to start immediately.

Similar Jobs

Data Scientist — LLM Evaluation

Remote (US) · $140k - $220k

pythonllmevaluationstatisticsnlpbenchmarking

AI Evaluation Engineer

Kitchener, Canada · $96k - $116k

fine-tuningagentsnlpllmalignmentevaluation

AI Evaluation Engineer

Vancouver, Canada · $115k - $132k

agentsllmnlpfine-tuningalignmentevaluation

Lead Data Scientist - Knowledge Retrieval

llmagentsmlopsnlpragfine-tuningembeddingsevaluation

Related searches:

Remote Jobs Mid-Level Jobs Remote Mid-Level Jobs Mid-Level NLP & Language AI Mid-Level AI Research Mid-Level AI Agents & RAG Mid-Level Backend & Systems evaluation python agents statistics nlp benchmarking

Get jobs like this delivered weekly

Free AI jobs newsletter. No spam.