A four-state price/quality scatter for a model shortlist — Pareto frontier drawn through the non-dominated models, dominated ones greyed and named their beater, and a movable iso-value line that names the best buy at the reader's own quality-per-dollar rate.
Preview in your theme
Loading preview…
This component is part of Pro
The install command, prompt and concept map are included with a Pro license — one purchase unlocks every Pro component, forever.
Arena Elo against price · 7 of 12 non-dominated · 3:1 input:output blend · list price
Best buy at this exchange rate
Kite-Pro
$3.20 / M · 1361 Elo · cost-adjusted 1305
Non-dominated
7 of 12
6 can win at some rate · 5 dominated
Exchange rate — Elo gained per extra $1 / M tokens
17.5 Elo / $1
Wren · 4 models (34%) · 2 on the frontierLark · 4 models (33%) · 1 on the frontierKite · 4 models (33%) · 4 on the frontierdominated · 5
A model is dominated when another is at least as good and no dearer — greyed here, 5 of 12. The solid line joins the models nothing beats; its segments connect measured models and claim nothing in between. The dashed line is your own value line at 17.5 Elo per $1 / M: it rests on Kite-Pro, and no model sits above it. Its cost-adjusted figure, 1305, is where that line would meet a price of zero — off the left of a logarithmic axis, which is why it is printed rather than drawn, and why a constant-rate line bends across the plot. Lark-70B is on the frontier yet never the pick: it sits under the chord from Kite-Flash to Kite-Pro, so routing that share of traffic across those two beats it at every rate.
Serving shortlist · Q1 refresh: Arena Elo against blended price per million tokens for 12 models, $0.18 to $9.50 on a logarithmic price axis. Higher Elo is better. 7 of 12 models are non-dominated; the other 5 are beaten on price and Elo at once. 6 of the 7 non-dominated models are the best buy over some stretch of exchange rates; Lark-70B never is, sitting under the chord from Kite-Flash to Kite-Pro. At 17.5 Elo gained per extra $1 per million tokens, Kite-Pro is the best buy: $3.20 per million tokens, 1361 Elo, cost-adjusted 1305. Every model is listed in the data table. Ranked by cost-adjusted Arena Elo at 17.5 Elo per extra $1 per million tokens.
Model
Family
Price per million tokens
Arena Elo
Cost-adjusted Arena Elo
Standing
Kite-Pro
Kite
$3.20
1361
1305
Best buy at this exchange rate — ahead from 9.53 to 22.9
Kite-Flash
Kite
$1.50
1322
1296
Best buy from 22.9 to 60
Lark-70B
Lark
$2.20
1330
1292
Non-dominated, but never the best buy at any rate
Wren-3
Wren
$4.20
1352
1279
Dominated by Kite-Pro
Kite-Ultra
Kite
$7.50
1402
1271
Best buy from 2 to 9.53
Wren-2
Wren
$0.60
1268
1258
Best buy from 60 to 152
Lark-Max
Lark
$5.00
1340
1253
Dominated by Kite-Pro
Wren-2 Pro
Wren
$2.80
1300
1251
Dominated by Lark-70B
Kite-Max
Kite
$9.50
1406
1240
Best buy below 2
Lark-8B
Lark
$1.10
1240
1221
Dominated by Wren-2
Wren-mini
Wren
$0.18
1204
1201
Best buy above 152
Lark-lite
Lark
$0.35
1180
1174
Dominated by Wren-mini
empty
Serving shortlist · Q1 refresh
Arena Elo against blended price per million tokens · 3:1 input:output blend · list price
No models to compare yet
A frontier needs at least one model carrying both a blended price per million tokens and a score for Arena Elo. Add a second and the card starts greying whatever is beaten on both at once.
loading
Serving shortlist · Q1 refresh
Arena Elo against blended price per million tokens · 3:1 input:output blend · list price
Loading cost-quality frontier
error
Serving shortlist · Q1 refresh
Arena Elo against blended price per million tokens · 3:1 input:output blend · list price
Couldn't load this frontier
The price or eval feed didn't respond.
ready · lower-is-better metric
Same endpoints · held-out loss
Held-out loss against price · 6 of 8 non-dominated · 3:1 input:output blend · internal held-out set
Best buy at this exchange rate
Kite-Flash
$1.50 / M · 1.87 nats · cost-adjusted 1.97
Non-dominated
6 of 8
6 can win at some rate · 2 dominated
Exchange rate — nats removed per extra $1 / M tokens
0.0642 nats / $1
Wren · 3 models (38%) · 2 on the frontierLark · 2 models (25%) · 1 on the frontierKite · 3 models (37%) · 3 on the frontierdominated · 2
A model is dominated when another is at least as good and no dearer — greyed here, 2 of 8. The solid line joins the models nothing beats; its segments connect measured models and claim nothing in between. The dashed line is your own value line at 0.0642 nats per $1 / M: it rests on Kite-Flash, and no model sits below it. Its cost-adjusted figure, 1.97, is where that line would meet a price of zero — off the left of a logarithmic axis, which is why it is printed rather than drawn, and why a constant-rate line bends across the plot.
Same endpoints · held-out loss: Held-out loss against blended price per million tokens for 8 models, $0.18 to $9.00 on a logarithmic price axis. Lower nats is better. 6 of 8 models are non-dominated; the other 2 are beaten on price and nats at once. 6 non-dominated models are the best buy over some stretch of exchange rates. At 0.0642 nats removed per extra $1 per million tokens, Kite-Flash is the best buy: $1.50 per million tokens, 1.87 nats, cost-adjusted 1.97. Every model is listed in the data table. Ranked by cost-adjusted Held-out loss at 0.0642 nats per extra $1 per million tokens.
Model
Family
Price per million tokens
Held-out loss
Cost-adjusted Held-out loss
Standing
Kite-Flash
Kite
$1.50
1.87
1.97
Best buy at this exchange rate — ahead from 0.0471 to 0.122
Zyeon UI