Beth Barnes
Model Evaluation & Threat Research (METR)
Titles as the sources gave them. In 2 entries, with 0 checked quotations.
Who they are
Roles and parties from Wikidata and from the sources in the Base, as precise as each gives them. When we compare what groups say, each statement counts in the group the person belonged to that day.
- Founder and chief executive officer, METR (Model Evaluation and Threat Research)December 2023–now · Wikidata
Wikidata: Q137382688
In the Base
Every entry they appear in.
Review of the "Misalignment in high-stakes settings" section in Anthropic's Risk Report (August 2026)
METR publishes its external review of the misalignment section of Anthropic's August 2026 Risk Report. METR agrees the risk is low for the covered models but attributes this mainly to limited capabilities, and says the report's methods could not reliably detect higher risk. It recommends end-to-end red-teaming of monitoring.
Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity
METR researchers report a randomized trial in which 16 experienced open-source developers completed 246 real tasks in mature repositories, each task randomly allowing or barring early-2025 AI tools. Tasks took 19% longer with AI allowed, although developers had expected a 24% saving. The authors caution against generalizing beyond this setting.