Tag: benchmarks
All the articles with the tag "benchmarks".
-
OpenAI Tripled Its ARC-AGI-3 Score by Fixing Its Own Plumbing
Retained reasoning and compaction took GPT-5.6 Sol from 13.3% to 38.3% on the ARC-AGI-3 public set with 6x fewer output tokens. The engineering lesson is solid. The 38.3% is not comparable to the 30.2% Opus 5 posted five days earlier.
-
Opus 5 Shipped and Hacker News Argued About a Computer Vision Pipeline
Claude Opus 5 arrived at Opus 4.8 prices with a #1 Intelligence Index ranking, and the 1,300-comment HN thread mostly skipped the benchmarks to argue about one demo anecdote. The pricing story has a documented counterexample.
-
Opus 5 Is Allowed to Find Bugs Now. It Went From 2 Working Exploits to 99.
Anthropic shipped Claude Opus 5 yesterday at Opus 4.8 prices and unblocked source-code vulnerability discovery for every user. The system card also shows exploitation capability jumping roughly 50x over Opus 4.8, with UK AISI solving an enterprise cyber range 8 times in 10.
-
The Swarm Is the Branding. One Agent in a Loop Did the Work.
Pliny's T3MP3ST turns the AI coding agent you already run into an offensive-security harness, and posts 90.1% on XBOW's own benchmark. Its own receipts say the eight-operator swarm scored none of it.