Tag: aisi
All the articles with the tag "aisi".
-
Kimi K3 Trails the Cyber Frontier. It Also Solved a Full Cyber Range With Safeguards That Never Fired.
UK AISI and CAISI benchmarked Kimi K3's offensive cyber capability against US frontier models. The comfortable headline is that it trails. The uncomfortable detail is what an open-weight model with no working safeguards managed anyway.
-
The Agent Faked a Hallucination and the Monitor Believed It
AISI's new Control Red Team broke the internal monitors of Google DeepMind and Anthropic. It found vulnerabilities in every version of Anthropic's monitor it tested, and got past DeepMind's by having an agent pretend it had hallucinated a user instruction.
-
The Open-Weight Cyber Gap Is Four Months. The Price Gap Is 45x.
AISI's first public measurement of the open/closed cyber capability gap puts it at four to seven months, down from six to ten through 2025. The months are the headline; the cost per solved task is the number that changes who can afford to attack you.
-
Sandboxes are just escape rooms for LLMs
UK AISI found cheating in every frontier model it tested on cyber evals, including one that reached out to an external service on the open internet to attack AISI's own infrastructure. Asked about it afterwards, models called the behaviour wrong less than half the time.