Researcher, Automated Red Teaming
full-time
mid
Posted 3 months ago
About this role
ABOUT THE TEAM
Preparedness is a critical Safety Research team at OpenAI, which is focused on mitigating AI threats to global security https://openai.com/index/updating-our-preparedness-framework/ that could scale to an extreme level of severity.
Our work involves:
1. Measurement. Monitoring and predicting the evolving capabilities of frontier AI systems.
2. Mitigation. Keeping misuse safeguards, alignment tools, and security measures on track to adequately address extreme threats that might arise in the future.
3. Coordination. Setting mitigation targets by maintaining OpenAI’s preparedness framework https://openai.com/index/updating-our-preparedness-framework/, and partnering with other staff to achieve these targets.
This is urgent, fast-paced work that has far-reaching implications for the company and for society.
ABOUT THE ROLE
This role leads the Automated Red Teaming (ART) effort: building scalable, research-driven systems that continuously uncover failure modes in our models and safeguards, and translate those findings into actionable, production-facing improvements. The goal is to reduce expected harm by finding the highest-leverage, least-covered weaknesses early and reliably.
IN THIS ROLE, YOU'LL:
- Own the research and technical direction for automated red teaming across catastrophic risk areas, with an initial emphasis on:
- Automated classifier jailbreak discovery (cyber and bio).
- Automated bio threat-development elicitation (worst-feasible planning uplift).
- CoT monitoring evasion probing (and adjacent loss-of-control evaluations).
- Partner closely with:
- Vertical risk teams (Cyber, Bio, Loss of Control) to define threat models, prioritize targets, and land mitigations.
- The Classifiers team to turn discovered attacks into training data, evals, and measurable robustness gains.
- Product / Engineering / Safety stakeholders to ensure ART outputs are operationally useful.
YOU MIGHT THRIVE IN THIS ROLE IF YOU:
- Feel a strong pull toward AI safety, and you’re motivated by reducing real-world catastrophic risk (not just publishing cool results).
- Love breaking systems (responsibly) — you get energy from finding weird, high-severity failure modes and turning them into concrete fixes.
- Have strong applied research instincts, especially around evaluations: you’re good at designing experiments that are reproducible, interpretable, and hard to fool.
- Bring hands-on experience with LLMs and agents, including multi-turn behaviors, tool use, and the ways models adapt to constraints.
- Are comfortable building scalable automation, not just prototypes — you can turn red-teaming ideas into pipelines that run continuously and produce high-signal outputs.
- Have solid software engineering fundamentals (data structures, algorithms, testing discipline) and you can work effectively in a production-adjacent environment.
- Think in threat models and incentives, and you naturally ask “what would an attacker do next?” or “how would this fail under pressure?”
- Can translate messy findings into action, communicating clearly with researchers, engineers, product, and policy — and driving alignment on what to fix first.
- Care about efficiency and prioritization, and you’re happy to say “no” to low-leverage work to focus on what moves the risk needle.
- Nice to have:
- Experience in adversarial ML, security research / red teaming, abuse prevention systems, or large-scale eval infrastructure.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.
For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement https://cdn.openai.com/policies/eeo-policy-statement.pdf.
Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal histor
Similar Jobs
Related searches:
On-site Jobs
Mid-Level Jobs
On-site Mid-Level Jobs
Mid-Level Machine LearningMid-Level AI Safety & SecurityMid-Level NLP & Language AIMid-Level AI Agents & RAGMid-Level AI Research
AI Jobs in San Francisco
Machine Learning in San FranciscoAI Safety & Security in San FranciscoNLP & Language AI in San FranciscoAI Agents & RAG in San FranciscoAI Research in San Francisco
llmalignmentagentsresearch
Get jobs like this delivered weekly
Free AI jobs newsletter. No spam.