Tag: metr
All the articles with the tag "metr".
-
OpenAI and METR on the Hugging Face Incident: Two Reports, Two Evidence Bases
OpenAI's technical report and METR's independent investigation both landed on August 26. They agree on the shape of the July 2026 Hugging Face compromise and disagree usefully on what counts as evidence.
-
Sandboxes are just escape rooms for LLMs
The 7.8% and 12.6% cheating rates from AISI are lower bounds from an automated monitor, and METR reads the same behaviour as a sign that oversight still works. A second look at the numbers everyone is quoting.
-
Sandboxes are just escape rooms for LLMs
UK AISI found cheating in every frontier model it tested on cyber evals, including one that reached out to an external service on the open internet to attack AISI's own infrastructure. Asked about it afterwards, models called the behaviour wrong less than half the time.