e·EvalMapAI CAPABILITY ATLAS
What’s newJeep builds · EvalMapBench · releases & odds
EvalMapBench 6.7 · measured here47 models on 43 private maintenance tickets written tersely; the score is the share of the details each ticket left unsaid that the model still got right, by a hidden verifier.
  1. Claude Mythos 5.192.1%
  2. Claude Fable 5.1 (high with fallback)91.3%
  3. Devin SWE-2 (max)89.0%
  4. Claude Opus 5.5 (medium)86.2%
  5. Claude Opus 5.5 (high)85.6%
  6. Muse Wonder Full (max)85.4%
  7. Claude Sonnet 5.5 (xhigh)84.4%
  8. Claude Sonnet 5.5 (high)84.1%
  9. Hy4 (high)84.1%
  10. GPT-6.1 Terra (Max)82.7%
  11. Muse Wonder (max)82.3%
  12. Grok 4.7 (xhigh)81.8%
  13. Kimi K3.1 Pro81.5%
  14. MiniMax M3.1 Flash81.3%
  15. GPT-6 Astra (xhigh)81.2%
  16. Grok 4.7 (high)81.2%
  17. GPT-6.1 Terra (High)81.0%
  18. Devin SWE-2 Flash (max)80.9%
  19. GPT-6.1 Sol (xhigh, ultrafast)80.9%
  20. Pareto 26.1080.4%
  21. DeepSeek V4.1 Flash (high, 500k context)80.1%
  22. GPT-6.1 Sol (high)80.1%
  23. GPT-6 Astra (high)80.0%
  24. GPT-6.1 Sol (high, ultrafast)79.6%
  25. LongCat 2.5 (max)79.6%
  26. DeepSeek V4.1 Flash (max)79.4%
  27. Claude Opus 5.5 (xhigh)79.3%
  28. DeepSeek V4.1 Flash (high, 1M context)79.3%
  29. Gemini 3.8 Flash (high)79.0%
  30. Gemini 4 Argon (max)78.9%
  31. Kimi K3 (max)78.6%
  32. GLM-5.3-FlashX78.5%
  33. GLM-5.3-Prime78.4%
  34. Muse Spark 1.3 Contributor (max)77.9%
  35. Ultramarine 1 Flash (max)77.8%
  36. Qwen3.8 27B (high, Cerebras)77.7%
  37. DeepSeek V4.1 Flash 1017 (Max)77.4%
  38. DeepSeek V4.1 Flash (high, 200k context)77.1%
  39. Mercury 3 (high)77.0%
  40. Claude Haiku 5.5 (Xhigh)75.9%
  41. Step 5 Preview73.0%
  42. Beam 1.071.1%
  43. Nemotron 3.5 Super VL54.7%
  44. Qwen3.8 Max Prime (high)46.6%
  45. Qwen3.8 Max Prime (xhigh)44.3%
  46. Ornith 1.5 122B (high)0.8%
  47. gpt-oss-120b (high)0.0%
The oddsout by 31 Oct
  1. Nemotron 3.5 Bolt E4B93%no market
  2. FastH3-Omni open weights85%no market
  3. Mistral Large 4 open weights80%no market
  4. The Claude model after Fable 5.142%market 84%
  5. Qwen4, any of the series26%market 84%
all 11 →
Expectedour reading of public signalslikely possible announcedwhat each rests on →

No day namedNext Fable model, possible, 5–11 Nov, no day named: a Fable 5.5 ID was seen in Azure on 13 Oct and testers post output they attribute to Fable 5.5; nothing from AnthropicOpenAI’s next model, possible, 5–11 Nov, no day named; the GPT‑6 Astra Cyber model OpenAI called ‘upcoming’ on 23 Oct came on 5 Nov as GPT‑6 Cyber, for approved Daybreak Red users onlyGrok 4.8, announced, no date, Named by Elon Musk on 14 Sep: pre-training to finish that week, then RL; no dateQwen4, announced, no date, Officially announced 22 Sep at Apsara: in training, “coming soon”, no date given (named on 26 Aug as the architecture Qwen3.8-Flash previews)DeepSeek V4.1-Pro, announced, no date, Named by DeepSeek on 10 Sep, with no date givenMiMo-V3, announced, no date, Named by Xiaomi’s MiMo lead Fuli Luo on 23 Sep, with its architecture; no dateKardashev-0.7, announced, no date, Announced 5 Oct; API-beta waitlist, homepage says ‘soon’, no release dateFern 0.1, announced, no date, Announced 26 Oct as Mirendil’s first model; access ‘Coming soon’, early-access requests only, no release date

Compare AI models in 3D.

Explore published benchmarks, speed and price. Pick two models to compare their numbers side by side, with a source for every value.

A reading tool for published measurements: apart from EvalMapBench, which the sources page describes, nothing on the chart is measured here, nothing is ranked, and there is no advice on what to buy. No ads, no accounts, no cookies, nothing sold.

199configurations30on the frontier
Quick pick

88 of 88 configurations are measured on all three axes and price by the chosen sources

Where each number comes fromArtificial Analysis for all four

Values are never blended. Each axis shows one published source at a time, and swapping a source can drop models the new source has never measured.

Knowledge · software engineering × Output speed × Terminal-Bench 4.0

Colour and cloud: price per 1M output tokens · size: Intelligence Index · ◆ Pareto frontier

40.0%21 of 152 plotted configurations are at or above it
$0$1$5$25$100
up to $6

100 of 152 plotted within the limit · the rest stay visible, darker

Drag to rotate · scroll or + and − to zoom · click a point to select it, and a line joins it to the one picked before

How to read the chart

Translucent cloud: everything at or below the price limit

Green plane: the level you set on axis Z

◆ Pareto frontier for the current axes, price and sources ● Other models ○ Deprecated configuration

Size → Intelligence Index
Larger means a higher score

What this is, and what it is not

A reading tool. EvalMap puts published measurements of 88 model configurations in one space so they can be compared. Nothing on the chart is measured or ranked by EvalMap, and it recommends nothing. Every number belongs to the source named beside it. Two judgements are EvalMap’s own, and both stay off the chart: the forecast in the release strip under the jeep banner — which models look likely this week — which says so and links to the posts it rests on; and the jeep bench, where a model named by the owner builds the same one-line game brief and the build is scored from 0 to 100 against a written rubric, in the jeep gallery. The chart takes only dates from that list: a ring marks each configuration first made available between 21 August 2026 and 9 November 2026.

No money in it. Nothing here earns from the data: no advertising, no affiliate links, no sponsorship, no paid placement, nothing for sale. No source pays to appear and none can pay to move. The links to models and sources are plain links.

Nothing that identifies you. No cookies, no accounts, no log-ins. The browser keeps one thing, and only if you pin a light or dark theme with the switch in the top bar: that choice, which is never sent anywhere. The page’s own code loads only files from this domain — no third-party scripts, no web fonts — and the one request it makes is for its own data file. What you choose — axes, sources, price limit, plane level, selected and pinned models — is written into the address bar so a link can be shared, and goes nowhere else. There is no server-side code. One thing is measured on purpose: Cloudflare’s own page counter (cloudflareinsights.com), kept on so it is known how many people read this. It sets no cookie, follows nobody between sites and reports totals only — pages, referrers, country, browser. Nothing here asks who you are.

What a score is worth. A benchmark result is a run, not a property of a model: one harness, one date, one set of tasks, with its own interval. Values from different sources are never blended — you choose one at a time — and a benchmark can be re-run, retired or trained against. The AA snapshot, taken from Artificial Analysis’s Data API, is frozen at 4 November 2026 (Intelligence Index v5), BridgeBench was re-read on 15 October 2026, the agent steps were read off Artificial Analysis’s Coding Agents page on 5 October 2026, and the release list is at 9 November 2026 (forecast last checked 9 November 2026); none updates by itself.

BridgeBench. Its ratings are editorial — a fixed conversion of BridgeBench’s own comparative assessments, not pass rates from a test anyone can rerun — and its prompts, tasks and rubrics are private. It is run by BridgeMind, which sells an agent app and sells sponsorship on the leaderboard page. It publishes no licence and no terms, so its values are republished with attribution as a matter of practice, like Vals AI’s.

Artificial Analysis. Their values are republished here with attribution although none of their tiers permits it, and the page says so rather than implying a licence exists. The openly licensed sources are used under their licences. Any source owner who wants values removed or corrected can write to support@evalmap.ai and it will be done.

No endorsement. None of the sources endorses EvalMap, is affiliated with it or has reviewed it. Their names are used only to say where a value came from.

Data and methodology +

Sources: Each axis draws from one named source at a time, never a blend. Artificial Analysis runs one harness over all 88 configurations, so its evaluations are internally comparable; since 8 October that includes CritPt, 71 unpublished research-level physics problems on which every model scores low (32% at best). AA now times every configuration on the atlas. An untimed one would be placed by a separate, labelled visual source at 0 below the positive log scale; that zero is not a measurement and is excluded from Pareto comparisons and the price cloud. The Terminal-Bench 4.0 official board and DeepSWE v1.1 are vendor-submitted runs on each model’s native agent, published with a 95% interval, and reach 4 and 11 configurations respectively. Epoch AI contributes five feeds: the Capabilities Index for 60 configurations, and its own runs of GPQA Diamond (15), Mock AIME (17), FrontierMath tiers 1-3 (15) and SimpleQA Verified (14), each with the standard error of that run. LMArena contributes ten leaderboards: the style-controlled text arena (26), coding prompts (26), maths prompts (24), expert prompts (26), votes scored for factuality (26), the WebDev arena (27), and the agent arena (24) with three of its five signals: invented tools (24), bash recovery (21) and steerability (24). BridgeBench contributes ten editorial ratings of 30 coding models — overall and nine axes: reasoning, front end, back end, one-shot completeness, security, trustworthiness, efficiency, speed and cost — one rating per model, so every reasoning variant of a model shares it (51 configurations; rows run without reasoning are left out); its Speed and Cost are judgements of time and spending to a useful result, not tokens per second or a price. Vals AI contributes six boards from domains no other source here reaches, each one its own run on its own harness: legal research (29 of the 88 configurations), legal agent work over real documents (24), LegalBench (16), tax (14), medical billing codes (23) and the work of a financial analyst (29). A standard error is published beside every value except on the legal agent and medical billing boards, whose pages stopped serving it in October 2026. Price is carried by three independent sources — Artificial Analysis for 88, models.dev for 72 and LiteLLM for 65 — and the context window by models.dev for 74 and LiteLLM for 67. Swapping a source can therefore remove models the new source has never measured, and the coverage figure next to each picker says how many remain. Where a submitted run used a different reasoning effort from the row it lands on, the selected-model panel states the mismatch instead of hiding it. Full terms are on the sources and licences page.

Axes: Output speed always holds the Y axis, and price per million output tokens is the cloud and the colour ramp; you choose X and Z. Three large buttons above the chart turn it to one kind of evidence at a time: Artificial Analysis (its software-engineering knowledge index against its Terminal-Bench 4.0 run), BridgeBench (one-shot completeness against overall, with no price limit dimming the field) and EvalMapBench (solved against Terminal-Bench 4.0). The pickers stay free, and either coding benchmark — Terminal-Bench 4.0 or DeepSWE v1.1 — can take an axis. The three law axes are Vals AI’s own runs. No legal figure from Artificial Analysis appears anywhere here: the AA-Omniscience law domain and the AA Legal Index are served only as an encrypted client-side payload whose extraction their terms forbid, and that payload is still untouched.

Two things worth reading twice: the agent arena publishes an IPS score from LMArena’s causal tracing of live sessions rather than a Bradley-Terry rating: how much a session’s outcome changes when this model runs the agent, against a baseline LMArena describes as typically a uniform mix of models. Zero is that baseline. The four agent scores are differences in outcome, not votes, so compare them only within one agent board. And models.dev lists the same model at many providers, including free and resold ones; the price shown is the model owner’s own listing where there is one, with the full spread of listings recorded beside it.

Green plane: A bar on the Z axis, and yours to move. It starts at 40 % on Terminal-Bench 4.0 and on DeepSWE, at 150 on Epoch’s scale because that is where GPT-5 sits, at 0 on the knowledge indices because that is where errors cancel correct answers, and on each Vals AI board at a round number near the middle of that board’s field, because each of them has a ceiling of its own. The slider says how many measured configurations reach it. It is decoration only: no value, no colour and no frontier changes when it moves.

Pareto frontier: No other configuration is at least as good on all three axes and at least as cheap, and better on at least one. The frontier is recomputed whenever you change an axis, so the diamonds always describe what is on screen.

Epoch Capabilities Index: Not a percentage and not comparable to the pass rates on this page. It is a fitted latent scale anchored so that Claude 3.5 Sonnet sits at 130 and GPT-5 at 150, with no upper bound. Its interval is a 90 % bootstrap over 500 resamples, narrower in kind than the 95 % intervals the benchmark boards publish. Epoch fits one score per model rather than one per reasoning effort, so every effort variant of a model carries the same figure — 45 of the 60 rows inherit a score that way, and each says so. It is also not independent of the rest of this page: Epoch’s fit consumes DeepSWE and Terminal-Bench results for many models, so reading ECI against those axes is partly circular.

Human preference: Six LMArena boards come from blind paired votes: the style-controlled text arena, coding prompts, maths prompts, expert prompts, factuality and the WebDev arena. They are the only numbers here that measure what people preferred rather than whether a task passed. The text arena reaches 26 of the 88 configurations. Arena identifiers are matched in three deterministic steps — the identifier is a row’s display name without its effort bracket, or else its slug, and the name wins because a slug can hide a checkpoint (Qwen3.8 Max and Qwen3.8 Max (0902) are two rows, and the arena lists them apart); names are compared word by word, and failing that as letters and digits alone, so “Qwen 3.8 27B” is qwen3.8-27b; where several rows share a name, one per effort, the entry goes to the one that states no effort, else to the row whose slug it is, and a slug ending in -reasoning, -thinking or -non-reasoning counts as stating one; or it splits into a base plus an effort level the row states; or it names the only effort variant the arena publishes for a row whose effort Artificial Analysis leaves unstated — with no fuzzy matching and no alias table. Each row takes its best match, so the order of a board changes nothing, and a row with two equally good matches gets neither. Where only one side names an effort — LMArena lists qwen3.8-27b with none, Artificial Analysis measured that row at xhigh — the value says so in a caveat built from the dataset alone: 26 values on 3 rows. The interval is the half-width of the bounds LMArena publishes, and it is a 95 % one: the agent arena states that level, and in every Bradley-Terry table each bound sits exactly 1.96 standard errors from the rating.

Vals AI: Six boards in professional domains: two agentic legal ones — research across eight areas of US law against rubrics written by practising firms, and Harvey’s benchmark of legal work done over documents, spreadsheets and presentations with file tools — plus LegalBench, tax, medical billing codes and an agent doing the work of a financial analyst. Vals runs every evaluation itself and publishes the standard error and the reasoning effort of each run, which is how these values land on the right row. Four things to know before reading them. The benchmarks are not all theirs: the agent board and its scoring are Harvey’s, LegalBench is Stanford CodeX’s dataset and the coding set is Protege’s, with Vals as the one who ran the models. Legal research, tax, medical coding and the finance board are graded on held-out task sets Vals does not publish, so those four cannot be reproduced from outside. The two agentic legal boards sit near their floor — half the field scores under 4 % on the Harvey board and a refusal counts as a failure — while LegalBench is saturated at the other end, the whole frontier within four points of 89 %, so read the first for spread and the last for a floor. And Vals scores one reasoning effort per model, so a board reaches at most one row of each model family: that is the practical ceiling of its coverage, not a shortfall. Their cost per task and latency per task are not carried here, because neither is the same measurement as price per million tokens or tokens per second. Their coding and knowledge boards are left out for the same reason: they would put a second, differently harnessed number under a benchmark name this page already carries.

Terminal-Bench 4.0: The two sources are separate runs of the same 66 tasks, not copies of each other. Artificial Analysis scores pass@1 over 198 trials on its own harness; the official board scores 330 trials on the vendor’s own agent. At maximum effort they agree within a few points, but at lower efforts they can differ by ten points or more, and the board only carries configurations a vendor chose to submit.

Speed: Median output speed across the providers serving each model, as AA’s Data API gives it on the snapshot’s day, measured with approximately 10,000 input tokens. Intelligence Index v5 is a composite benchmark score, not human IQ; it already includes Terminal-Bench and Omniscience, so plotting them against each other is partly self-referential.

Knowledge: The AA-Omniscience Index runs from −100 to 100: correct answers increase the score, errors lower it, abstentions incur no penalty. A negative score means more errors than correct answers. The all-domains index covers six domains including humanities, law, business and software engineering; the SWE index is the software-engineering domain alone, and accuracy is the raw share of correct answers before the error penalty. The all-domains index and accuracy are available for every configuration, and the SWE index for all 88 as well: since 6 October the snapshot comes from AA’s Data API, whose per-model detail carries the software-engineering domain of AA-Omniscience directly, so no value is carried from an older extract or read off a chart any more.

Price limit: Price is not an axis. The slider inflates a translucent cloud around every configuration at or below the limit, so the shape itself is the answer to “what can I afford here”. Models above the limit stay visible, drawn darker and greyer. The default limit is $6 per million output tokens.

Price: USD per million output tokens. Input costs and the number of reasoning tokens used are not compared here. Artificial Analysis reports one price per configuration; five of them are $0, which is why the axis is symmetric-log rather than log. LiteLLM instead lists every provider it knows resells a model, so its value is the cheapest of those and the panel reports how many providers and how wide the spread was. The two disagree for open-weight models in particular, where AA often records $0 and a hosted provider charges for serving.

Attribution: Source: Artificial Analysis (artificialanalysis.ai), Terminal-Bench 4.0 (Apache-2.0), DeepSWE v1.1 (Apache-2.0) and LiteLLM (MIT), Epoch AI · Epoch Capabilities Index (CC BY 4.0) and LMArena (CC BY 4.0), Vals AI (vals.ai) and BridgeBench (bridgebench.ai), which publish no licence and no terms of use — their values are republished with attribution as a matter of practice, and the benchmark owners named above keep their own. Benchmark questions and answers remain the property of their creators, and externally sourced results keep their original terms. None of these projects endorses EvalMap, is affiliated with it or has reviewed it.

AA-Omniscience methodology ↗