Ranked 2 of 5 overall on 202 tasks. Strongest on monitoring at 93.2, weakest on credit analysis at 83.7.
Score
86.3
rank 2 of 5
Latency
86.1s
median per task
Cost
$0.519
per task at list prices
Capability profile
Mean score per category on question-answering, 0–100.
Score by category
5 categories, 152 tasks on question-answering.
Credit Analysis83.7 · 62
Monitoring93.2 · 20
Structured Products86.7 · 18
Research Intelligence84.6 · 10
Discovery & Prediction85.6 · 2
Where it sits
sonnet-5 against the rest of the board. Everything else is drawn back so the one model reads.
sonnet-5 on the frontier — no model beats it on bothFrontier · 3 models nothing beats on both
Best per task is the diamond: for each of the 200 tasks every model attempted, the highest score any of them got, averaged — 95.0 against 91.3 for opus-5 used on everything. Nobody can build it. The choice is made with the result in hand, which a router does not have when it has to choose, so it marks the edge of what having 5 different models is worth rather than a score anyone can reach. It is also flattered by noise — the highest of 5 measurements rises with the count even when the models behind them do not improve — so it will drift up as models are added and is not comparable between boards with different numbers of them. 2 tasks are left out of it, for not having been attempted by every model. Its cost is measured the way the board measures a model’s, on the question-answering track that holds more of the tasks.