Back to the trend of the day: Intel's boss warns billions of AI helpers will be hard to control
Poly Rating · from the trend of the day

AI Agent Cost Comparison 2026: Most Work per Dollar

On Arena's Nov 4 coding board, a median Claude Opus 5.5 task costs $17.45 and GPT-6.1 Terra $1.40: about 12 times the price for 23.38% net improvement against 13.76%.

  • No. 1: GPT-6.1 Sol (OpenAI Codex)
  • 10 places

01Final list

The leading AIs each built their own list of ten independently. Here is one result that is easy to check: every place has a reason, a source, and the list of AIs that included it.

Order: from most to least AI agreement.

A bright badge means this AI put the entry on its list. A dim badge means it did not.

  1. 1

    GPT-6.1 Sol (OpenAI Codex)

    The cheap pick three separate boards agree on: 12.51% Arena net improvement at $0.98, 62.9% on the Coding Agent Index at $1.04, 58.2% on Terminal-Bench at $1.92.

    Included it: ChatGPT, Meta, Grok, StepFun, Kimi, DeepSeek. Did not include: Nemotron, Wenxin.

    In their lists: ChatGPT: 2 · Meta: 1 · Grok: 3 · StepFun: 3 · Kimi: 1 · DeepSeek: 4

    What each AI noted 6
    • ChatGPTplace 2

      A $0.98 median task cost and 10.3-minute median duration make it a practical value candidate for controlled coding workflows.

      Source ↗
    • Metaplace 1

      $0.98 median in Arena, $1.27 per Intelligence Index task for 55 pts – 8x cheaper than Opus 5.5 max at $10.04 for 58 pts

    • Grokplace 3

      A 98-cent overall median buys 12.51% net improvement, a step ahead of Terra and a step behind on shell recovery.

      Source ↗
    • StepFunplace 3

      OpenAI's cost play: within two points of its pricier siblings on the same board at $0.56 a median task.

    • Kimiplace 1

      62.9% of real engineering tasks solved at $1.04 and 15.5 minutes each — about 60 index points per dollar, six times the work-per-dollar of the leaderboard's top scorer.

      Source ↗
    • DeepSeekplace 4

      58.2% for $1.92 — one-fifth of Astra's $9.90 on the same test.

    6 AIs put it here
  2. 2

    Claude Opus 5.5 (Claude Code)

    Highest overall net improvement (20.14%), but $17.45 and 39 minutes per median coding task. Terminal-Bench runs price it at $14.30–$19.07.

    Included it: ChatGPT, Meta, Grok, StepFun, Kimi, DeepSeek. Did not include: Nemotron, Wenxin.

    In their lists: ChatGPT: 6 · Meta: 8 · Grok: 7 · StepFun: 4 · Kimi: 9 · DeepSeek: 6

    What each AI noted 6
    • ChatGPTplace 6

      It leads Arena's overall November 3 ranking, but $6.80 per median task means its premium must be justified by fewer failed or repeated attempts.

      Source ↗
    • Metaplace 8

      $0.08 median absolute cheapest – 0.62% overall, 1.9 min, 26.1K tokens at $0.10/$0.50

      Source ↗
    • Grokplace 7

      Most net improvement on the board, 20.14%, at $6.79 overall and $17.45 when the task is code.

      Source ↗
    • StepFunplace 4

      The best value inside the best family: #1 steerability and #2 confirmed success at $1.31 a task, 64% below its own Max tier.

      Source ↗
    • Kimiplace 9

      The priciest reliable workhorse: 66% task success at $13.04 — you pay roughly double per task versus Codex, and independent tracking says it finishes in a 2.2-minute median.

      Source ↗
    • DeepSeekplace 6

      64.8% at $14.30 — reliable work, at a price that needs a high-value task to pay back.

    6 AIs put it here
  3. 3

    Claude Sonnet 5.5 (Claude Code)

    Ties Opus 5.5 on confirmed coding success (24.98%) at $8.39 per median coding task instead of $17.45. Overall: 15.42% net improvement at $3.86.

    Included it: ChatGPT, Meta, Grok, StepFun, Kimi. Did not include: Nemotron, DeepSeek, Wenxin.

    In their lists: ChatGPT: 5 · Meta: 5 · Grok: 5 · StepFun: 6 · Kimi: see list

    What each AI noted 5
    • ChatGPTplace 5

      The $3.86 median cost is much higher than the sub-dollar alternatives, but 19.95% confirmed success makes its reliability-adjusted value competitive.

      Source ↗
    • Metaplace 5

      74.55% GAIA leader for $178.20 – 15.42% Arena confirmed for $3.83, 16.4 min – best research work per dollar

    • Grokplace 5

      Ties Opus on confirmed coding success, 24.98%, at $8.39 instead of $17.45.

      Source ↗
    • StepFunplace 6

      Second-best confirmed success on the whole board (20.21%) for $3.86 a task — the mid-tier Anthropic pick that keeps most of the reliability.

      Source ↗
    • Kimi

      Named differently in its own list: open the full list.

      see list
    5 AIs put it here
  4. 4

    Gemini 4 Argon

    On chat tasks, 13.22% net improvement for 52 cents in 3.8 minutes. Weaker on code: 8.54% at $2.14 on Arena, and $5.84 per task in Google's Antigravity CLI.

    Included it: ChatGPT, Meta, Grok, Kimi. Did not include: Nemotron, StepFun, DeepSeek, Wenxin.

    In their lists: ChatGPT: 3 · Meta: 3 · Grok: 2 · Kimi: 3

    What each AI noted 4
    • ChatGPTplace 3

      At $0.97 and 7.3 minutes per median task, it is faster and cheaper than Carbon, though Carbon has the stronger overall improvement signal.

      Source ↗
    • Metaplace 3

      $0.97 median, 10.53% overall – 0.42% tool hallucination lowest among top 10, 13.52% steerability

    • Grokplace 2

      On chat tasks, 13.22% net improvement for 52 cents and 3.8 minutes.

      Source ↗
    • Kimiplace 3

      Best DeepSWE score on the board (78.8%) at $5.84 a task — the strongest hard-coding work per dollar among the big-three harnesses.

      Source ↗
    4 AIs put it here
  5. 5

    Gemini 4 Carbon

    Most quality for under $2: 16.72% net improvement and 18.02% confirmed success at a $1.69 median, about a quarter of Opus 5.5's $6.79. Arena still marks it preliminary.

    Included it: ChatGPT, Meta, Grok, StepFun. Did not include: Nemotron, Kimi, DeepSeek, Wenxin.

    In their lists: ChatGPT: 1 · Meta: 4 · Grok: 4 · StepFun: 2

    What each AI noted 4
    • ChatGPTplace 1

      At $1.69 per median task, it delivers 18.04% user-confirmed success in Arena's November 3 snapshot, making it the strongest observed balance of price and completion among leading models.

      Source ↗
    • Metaplace 4

      16.72% confirmed #2 overall for $1.69 – 19.32% steerability best, 0.51% hallucination

    • Grokplace 4

      The value leader that still wins tasks: 16.72% overall net improvement at $1.69, and Arena marks it preliminary.

      Source ↗
    • StepFunplace 2

      The efficiency pick that also wins: #2 overall on Agent Arena at $1.69–$1.80 a task, a fifth of the price of the agent above it on confirmed success.

      Source ↗
    4 AIs put it here
  6. 6

    DeepSeek V4.1 Flash

    The cheapest real entry at a $0.16 median, but only 2.37% net improvement on Nov 4; an earlier Arena post showed +4.87% at $0.07.

    Included it: ChatGPT, Meta, Grok, StepFun. Did not include: Nemotron, Kimi, DeepSeek, Wenxin.

    In their lists: ChatGPT: 8 · Meta: 7 · Grok: 9 · StepFun: 1

    What each AI noted 4
    • ChatGPTplace 8

      At $0.16 per median task, it is among the cheapest observed options, but the 3.38% confirmed-success signal prevents a higher finished-work ranking.

      Source ↗
    • Metaplace 7

      $0.16 median cheapest coding – 2.37% overall, 86.5K tokens, $0.15/$0.60 per M

      Source ↗
    • Grokplace 9

      Close to Astra on quality, 13.86% versus 14.70%, at a similar $6.40 median and a $16.30 coding median.

      Source ↗
    • StepFunplace 1

      $0.07 median per task for +4.87% net improvement — roughly 97 times cheaper than the board's #1 agent for work that is only a few points worse.

      Source ↗
    4 AIs put it here
  7. 7

    Devin (Cognition)

    The cost per task depends on who counts it: $0.60 (vendor claim), $1.40 at 70.4% (third-party DeepSWE), $7.90 (Coding Agent Index), about $9–10 per merged task (third-party estimate).

    Included it: Meta, StepFun, Kimi, DeepSeek. Did not include: ChatGPT, Grok, Nemotron, Wenxin.

    In their lists: Meta: see list · StepFun: 7 · Kimi: 5 · DeepSeek: 2

    What each AI noted 4
    • Meta

      Named differently in its own list: open the full list.

      see list
    • StepFunplace 7

      Cognition claims 64% lower cost than the frontier coding model — implying about $1.18 a task — while other arithmetic puts a merged task near $9–$10.

      Source ↗
    • Kimiplace 5

      $7.90 buys 61.7% task completion with SWE-2 Medium handling the heavy lifting — mid-pack price, top-tier reliability per dollar for delegated tickets.

      Source ↗
    • DeepSeekplace 2

      68.8 at $0.60 — if you count the FrontierCode run and not the $500/month seat.

    4 AIs put it here
  8. 8

    GPT-6.1 Terra

    The cheapest strong performer: a $0.79 median for 11.40% net improvement, and $1.40 per coding task against $17.45 for Opus 5.5.

    Included it: ChatGPT, Meta, Grok. Did not include: Nemotron, StepFun, Kimi, DeepSeek, Wenxin.

    In their lists: ChatGPT: 4 · Meta: 2 · Grok: 1

    What each AI noted 3
    • ChatGPTplace 4

      The $0.79 median task cost undercuts Sol's $0.98, but the observed overall improvement signal is lower.

      Source ↗
    • Metaplace 2

      Cheapest top-10 scorer at $0.96 per task for 48 pts – $0.79 median Arena, 11.4% success, 15.18% steerability

    • Grokplace 1

      11.40% overall net improvement at a 79-cent median, and $1.40 on a coding task.

      Source ↗
    3 AIs put it here
  9. 9

    Kimi K3.1 Pro

    A $1.47 median for 5.29% net improvement (preliminary): under half of Terra's gain at nearly twice the price. Toloka found 41% of K3's tasks solved only sometimes.

    Included it: Meta, Grok, StepFun. Did not include: ChatGPT, Nemotron, Kimi, DeepSeek, Wenxin.

    In their lists: Meta: 6 · Grok: 6 · StepFun: 5

    What each AI noted 3
    • Metaplace 6

      #1 open model tie – 5.29% overall, $1.47 median, 6.8 min, 41.4K tokens at $2/$10 per M

      Source ↗
    • Grokplace 6

      Positive, not cheap-and-empty: 5.29% overall net improvement at $1.47, far behind Terra's 11.40% at 79 cents.

      Source ↗
    • StepFunplace 5

      $1.03 a median task and it still lands just off the Pareto frontier — the cheapest credible route into top-tier agentic work.

    3 AIs put it here
  10. 10

    GPT-6 Astra

    Fourth on overall quality (14.70%), yet $6.16 per median task and $15.30 on code; Sonnet 5.5 gets more done for $3.86.

    Included it: ChatGPT, Grok. Did not include: Meta, Nemotron, StepFun, Kimi, DeepSeek, Wenxin.

    In their lists: ChatGPT: 10 · Grok: 8

    What each AI noted 2
    • ChatGPTplace 10

      Its $6.16 median task cost and 14.28% confirmed-success signal make it a premium option rather than a general price-performance winner.

      Source ↗
    • Grokplace 8

      Fourth on overall quality, 14.70%, and already $15.30 before a coding task is done.

      Source ↗
    2 AIs put it here

More about the top three ↓

02More about the top three

The ranking is above. Here is more about the three places at the top: what they are, why they are here, and what is worth knowing.

The numbers come from different tests: Arena overall and coding medians, Terminal-Bench, and the Coding Agent Index. Costs per task differ between them, so compare them only within one test.

1GPT-6.1 Sol (OpenAI Codex)

No. 1 — GPT-6.1 Sol (OpenAI Codex). On the lists of 6 of 8 AIs; median place there: 2.5. Three separate boards agree it gets solid results for the least money, about a dollar per task.

Did you know

  • GPT-6.1 Sol can read a huge amount at once. Its listed context window is 1,050,000 tokens, and it can write up to 128,000 tokens in one reply. That is enough room to hold a very large codebase in a single session.

What it is
OpenAI's Codex coding agent running the GPT-6.1 Sol model.
Its edge
Costs far less per task than the two Claude options on every board.
Who it suits
Suits budget-minded coding work; less suited if you need the highest net improvement.
  • Net improvement versus cost12.51% net at $0.98

Wikipedia · Wikidata

Why it is here
  • On Terminal-Bench Science 0.1 at maximum effort, GPT-6.1 Sol averages $5.47 per task. Claude Opus 5.5 averages $23.21 on the same harness, so Sol costs about a quarter as much.

  • TechRepublic's October 2026 comparison reports a cost per task of $1.04 for Codex with GPT-6.1 Sol. Claude Code with Sonnet 5.5 is listed at $14.19. I could not open this page to check the figures myself; they come from the search summary.

Did you know
  • Its listed API price is $2 per million input tokens and $10 per million output tokens. That is the price that sits behind the 'cheap pick' label, since most of an agent's cost comes from the tokens it reads and writes.

History
  • In May 2025 the cloud version of Codex launched, but few people outside OpenAI kept using it. The team, which had about seven weeks to build it, then turned to tools that run on your own computer. That change became the base for today's Codex.

Where to go further
  • Open OpenAI's official GPT-6.1 Sol launch post. Read the benchmark table first, then check the plan notes to see which Codex plans include the model before you try it.

Compare the top three ↓

2Claude Opus 5.5 (Claude Code)

No. 2 — Claude Opus 5.5 (Claude Code). On the lists of 6 of 8 AIs; median place there: 6.5. It gets the most net improvement overall, but each coding task costs far more and takes much longer.

Did you know

  • Claude Code's rewind does not undo everything. It only tracks edits made with Claude's own file-editing tools. Changes made by shell commands, such as deleting or moving files, are not covered. Checkpoints do survive across sessions.

What it is
Anthropic's Claude Code agent running the Opus 5.5 model.
Its edge
Highest net improvement on the board, though it is the most expensive per task.
Who it suits
Suits hard, high-value work; less suited to easy tasks or tight budgets.
  • Net improvement versus cost20.14% net, $17.45 per task

Wikipedia · Wikidata

Why it is here
  • Artificial Analysis lists Claude Code with Opus 5.5 at 62 on its Coding Agent Index. That is the cost-heavy side of the trade: $11.42 per task and 1.0 hour per task.

  • On Terminal-Bench Science 0.1, Claude Opus 5.5 averages $23.21 per task. GPT-6.1 Sol averages $5.47 on the same test, so Opus costs over four times as much.

History
  • Claude Code started in February 2025 as a limited research preview, released alongside the Claude 3.7 Sonnet model.

Keep in mind
  • With unclear intent or missing context, auto mode may still approve unsafe actions, and may block harmless ones. Each action gets an extra review step, which can add delay and cost more tokens over time.

  • Anthropic recommends running auto mode in isolated environments, especially for sensitive code. In practice, treat it as a helper to watch, not something to leave alone.

Where to go further
  • Open the permission modes page to see what each mode lets Claude Code do without asking. Read the Auto mode part first, since it is now the starting mode.

Compare the top three ↓

3Claude Sonnet 5.5 (Claude Code)

No. 3 — Claude Sonnet 5.5 (Claude Code). On the lists of 5 of 8 AIs; median place there: 5. It matches Opus on confirmed coding success at about half the price per task, so it keeps most of the value.

What it is
Anthropic's Claude Code agent running the cheaper Sonnet 5.5 model.
Its edge
Ties Opus on confirmed coding success for much less money per task.
Who it suits
Suits Claude users who want reliability on a budget; less suited to the very cheapest work.
  • Net improvement versus cost15.42% net at $3.86

Wikipedia · Wikidata

Why it is here
  • Artificial Analysis lists Claude Sonnet 5.5 as a Claude Code variant next to Opus 5.5. The Opus 5.5 setup is shown at $11.42 per task and 1.0 hour per task. This page does not give Sonnet's own cost figure.

  • On AutomationBench, Claude Sonnet 5.5 averaged $1.14 per task, according to Vellum's write-up. That is a different test from coding, so it only shows that Sonnet can be cheap on some jobs.

Compare the top three ↓

The top three side by side

GPT-6.1 Sol (OpenAI Codex)Claude Opus 5.5 (Claude Code)Claude Sonnet 5.5 (Claude Code)
In the AIs' lists6 / 86 / 85 / 8
Net improvement versus cost12.51% net at $0.9820.14% net, $17.45 per task15.42% net at $3.86
Put first byMeta, Kimi——

Places with the same number of AIs are ordered by their average place in the AIs' own lists.

03Worth knowing

What the AIs noticed while building the list.

A coding task and a chat task are different purchases: Opus 5.5's median is $17.45 and 39.3 min on code against $3.68 and 10.4 min on chat; Terra's is $1.40 and $0.58.

Noticed by:
Included it: Grok. Did not include: ChatGPT, Meta, Nemotron, StepFun, Kimi, DeepSeek, Wenxin.
Source ↗

Nobody publishes the dollar cost of rework, wrong tool calls or human rescue. Arena's tool-hallucination and bash figures are net improvements, not receipts for failed jobs.

Noticed by:
Included it: ChatGPT, Grok, StepFun, DeepSeek. Did not include: Meta, Nemotron, Kimi, Wenxin.
Source ↗

Arena's own surfaces quote different costs for the same model: Opus 5.5 at $6.80 (Pareto), $8.93 (work board) and $12.51 (cost post); Sol at $0.56 and $1.91.

Noticed by:
Included it: StepFun. Did not include: ChatGPT, Meta, Grok, Nemotron, Kimi, DeepSeek, Wenxin.
Source ↗

HAL warns that its GAIA costs are overstated exactly 2× for runs with nested trace spans, yet Claude Sonnet 4.5's line still shows $178.20 for 74.55%.

Noticed by:
Included it: ChatGPT, Meta, Grok, Kimi, DeepSeek. Did not include: Nemotron, StepFun, Wenxin.
Source ↗

04How we counted

In plain words, no formulas.

1The question

Top 10 AI Agents That Do the Most Real Work per Dollar

2Why this topic

Pricing pages and leaderboards each show half the picture. This puts success, cost and time on one scale per task type, so readers see which agent is actually the bargain.

3Where it applies

Global: AI coding agents, computer-use assistants and general task agents

4What we looked at

  • Verified task success on finished user goals, not demos
  • Real median cost per task, including model and tool use where disclosed
  • Time to finish comparable tasks
  • Failure and rework burden: wrong tool calls, hallucinated operations, tasks a human had to rescue
  • Final order: verified useful work per dollar, adjusted for time and reliability, shown separately for coding, research and browser tasks, with the coverage of each comparison stated
  • Arena: Agent Arena overall (Nov 4, 2026) — Net improvement, confirmed success and realized median cost and time per task for 58 models over about 2.76M sessions; 'net improvement' is a treatment effec
  • Arena: Agent Arena code board — The same signals on 912,449 coding sessions
  • aiplans.dev: Coding Agent Index v1.5 (Oct 13, 2026) — Pass@1 on DeepSWE, Terminal-Bench 4.0 and SWE-Atlas-QnA with measured cost and time per task, by agent product

5Who ranked

The leading AIs, each building its own list of ten independently and naming a source for every place: ChatGPT, Meta, Grok, Nemotron, StepFun, Kimi, DeepSeek, Wenxin.

6How the places were set

The same entry written differently by different AIs was counted as one. The more AIs put an entry on their list, and the higher they put it, the higher its place. "AI agreement" shows how many of the AIs had it on their own list. Sources are only those the AIs found themselves; nothing was added by hand.

05Each AI's own list

🇺🇸 ChatGPT10 places · 3 notes

The same question, answered by ChatGPT alone. The final list above combines all the AIs.

  1. 1
    Gemini CLI with Gemini 4 Carbon

    At $1.69 per median task, it delivers 18.04% user-confirmed success in Arena's November 3 snapshot, making it the strongest observed balance of price and completion among leading models.

    Source ↗
  2. 2
    OpenAI Codex with GPT-6.1 Sol

    A $0.98 median task cost and 10.3-minute median duration make it a practical value candidate for controlled coding workflows.

    Source ↗
  3. 3
    Gemini CLI with Gemini 4 Argon

    At $0.97 and 7.3 minutes per median task, it is faster and cheaper than Carbon, though Carbon has the stronger overall improvement signal.

    Source ↗
  4. 4
    OpenAI Codex with GPT-6.1 Terra

    The $0.79 median task cost undercuts Sol's $0.98, but the observed overall improvement signal is lower.

    Source ↗
  5. 5
    Claude Code with Claude Sonnet 5.5

    The $3.86 median cost is much higher than the sub-dollar alternatives, but 19.95% confirmed success makes its reliability-adjusted value competitive.

    Source ↗
  6. 6
    Claude Code with Claude Opus 5.5

    It leads Arena's overall November 3 ranking, but $6.80 per median task means its premium must be justified by fewer failed or repeated attempts.

    Source ↗
  7. 7
    Claude Code with Claude Sonnet 5

    Its $1.09 median task cost is appealing for short coding jobs, but the November 4 confirmed-success estimate is too uncertain to call it a bargain on completed goals.

    Source ↗
  8. 8
    DeepSeek V4.1 Flash Agent Configuration

    At $0.16 per median task, it is among the cheapest observed options, but the 3.38% confirmed-success signal prevents a higher finished-work ranking.

    Source ↗
  9. 9
    MiMo-V2.6-Pro Agent Configuration

    Just $0.17 per median task, but 16.3 minutes and weaker overall improvement make its apparent cheapness less decisive.

    Source ↗
  10. 10
    OpenAI Codex with GPT-6 Astra

    Its $6.16 median task cost and 14.28% confirmed-success signal make it a premium option rather than a general price-performance winner.

    Source ↗

What ChatGPT noticed

Gemini 4 Carbon's November 3 median task cost of $1.69 is about one-quarter of Opus 5.5's $6.80, despite both ranking near the top of Arena's overall agent results. That does not establish four times as many finished goals per dollar.

Princeton warns that its GAIA costs can be overstated by exactly 2× for affected nested trace spans, while unaffected rows are not inflated. A simple cost leaderboard built from those uncorrected values can misrank agents.

LangChain found 57% of surveyed practitioners had agents in production, while 32% cited quality as a top barrier. The economic bottleneck is often reliable completion rather than token price alone.

🇺🇸 Meta10 places · 1 notes

The same question, answered by Meta alone. The final list above combines all the AIs.

  1. 1
    GPT-6.1 Sol Max – OpenAI 2026

    $0.98 median in Arena, $1.27 per Intelligence Index task for 55 pts – 8x cheaper than Opus 5.5 max at $10.04 for 58 pts

  2. 2
    GPT-6.1 Terra Max – OpenAI 2026

    Cheapest top-10 scorer at $0.96 per task for 48 pts – $0.79 median Arena, 11.4% success, 15.18% steerability

  3. 3
    Gemini 4 Argon High – Google 2026

    $0.97 median, 10.53% overall – 0.42% tool hallucination lowest among top 10, 13.52% steerability

  4. 4
    Gemini 4 Carbon High – Google 2026

    16.72% confirmed #2 overall for $1.69 – 19.32% steerability best, 0.51% hallucination

  5. 5
    Claude Sonnet 5.5 Max – Anthropic 2026

    74.55% GAIA leader for $178.20 – 15.42% Arena confirmed for $3.83, 16.4 min – best research work per dollar

  6. 6
    Kimi K3.1 Pro Max – Moonshot 2026

    #1 open model tie – 5.29% overall, $1.47 median, 6.8 min, 41.4K tokens at $2/$10 per M

    Source ↗
  7. 7
    DeepSeek V4.1 Flash Max – DeepSeek 2026

    $0.16 median cheapest coding – 2.37% overall, 86.5K tokens, $0.15/$0.60 per M

    Source ↗
  8. 8
    Claude Haiku 5.5 High – Anthropic 2026

    $0.08 median absolute cheapest – 0.62% overall, 1.9 min, 26.1K tokens at $0.10/$0.50

    Source ↗
  9. 9
    GPT-6 Luna Low – OpenAI 2026

    $0.01 median – 5.93% overall, 15.26% confirmed, 48 sec, 3.9K tokens – cheapest finished goal

  10. 10
    Cursor Agent – Anysphere 2026

    From $0 free tier to $20 Pro – IDE agent that does most real code work per dollar for daily dev loop

    Source ↗

What Meta noticed

57% have agents in production per LangChain 1340 pros, cost concerns dropped – quality 32% top barrier, not price

🇺🇸 Grok10 places · 4 notes

The same question, answered by Grok alone. The final list above combines all the AIs.

  1. 1
    GPT-6.1 Terra (2026)

    11.40% overall net improvement at a 79-cent median, and $1.40 on a coding task.

    Source ↗
  2. 2
    Gemini 4 Argon (2026)

    On chat tasks, 13.22% net improvement for 52 cents and 3.8 minutes.

    Source ↗
  3. 3
    GPT-6.1 Sol (2026)

    A 98-cent overall median buys 12.51% net improvement, a step ahead of Terra and a step behind on shell recovery.

    Source ↗
  4. 4
    Gemini 4 Carbon (2026)

    The value leader that still wins tasks: 16.72% overall net improvement at $1.69, and Arena marks it preliminary.

    Source ↗
  5. 5
    Claude Sonnet 5.5 (2026)

    Ties Opus on confirmed coding success, 24.98%, at $8.39 instead of $17.45.

    Source ↗
  6. 6
    Kimi K3.1 Pro (2026)

    Positive, not cheap-and-empty: 5.29% overall net improvement at $1.47, far behind Terra's 11.40% at 79 cents.

    Source ↗
  7. 7
    Claude Opus 5.5 (2026)

    Most net improvement on the board, 20.14%, at $6.79 overall and $17.45 when the task is code.

    Source ↗
  8. 8
    GPT-6 Astra (2026)

    Fourth on overall quality, 14.70%, and already $15.30 before a coding task is done.

    Source ↗
  9. 9
    Claude Fable 5.1 (2026)

    Close to Astra on quality, 13.86% versus 14.70%, at a similar $6.40 median and a $16.30 coding median.

    Source ↗
  10. 10
    Tencent Hy4 (2026)

    A $0.57 median and only 5.39% net improvement: the ratio looks thrifty, the finished gain does not.

    Source ↗

What Grok noticed

A coding task and a chat task are different purchases. On 4 Nov 2026, Claude Opus 5.5's median was $17.45 and 39.3 minutes on code, against $3.68 and 10.4 minutes on chat. GPT-6.1 Terra's medians were $1.40 and $0.58 on those same boards.

LangChain's survey of more than 1,300 practitioners found 57.3% had agents in production, while 32% named quality the top barrier and cost had dropped down the list. A failed run that a person has to rescue is not in that dollar figure.

Princeton's older GAIA board put Claude Sonnet 4.5 at 74.55% for a $178.20 run of the set, against a 92% human baseline cited for GAIA. HAL later warned that nested traces had doubled reported costs. Dividing the sticker by two is still not a published per-question price.

Arena's September harness study found that swapping Claude Code, Codex CLI or Pi changed the bill even when success rates stayed similar. The November leaderboard holds the harness constant and compares models, so it is not a price for those desktop apps.

🇨🇳 StepFun10 places · 4 notes

The same question, answered by StepFun alone. The final list above combines all the AIs.

  1. 1
    DeepSeek V4.1 Flash (Max)

    $0.07 median per task for +4.87% net improvement — roughly 97 times cheaper than the board's #1 agent for work that is only a few points worse.

    Source ↗
  2. 2
    Gemini 4 Carbon (High)

    The efficiency pick that also wins: #2 overall on Agent Arena at $1.69–$1.80 a task, a fifth of the price of the agent above it on confirmed success.

    Source ↗
  3. 3
    GPT-6.1 Sol (Max)

    OpenAI's cost play: within two points of its pricier siblings on the same board at $0.56 a median task.

  4. 4
    Claude Opus 5.5 (High)

    The best value inside the best family: #1 steerability and #2 confirmed success at $1.31 a task, 64% below its own Max tier.

    Source ↗
  5. 5
    Kimi K3.1 Pro (Max)

    $1.03 a median task and it still lands just off the Pareto frontier — the cheapest credible route into top-tier agentic work.

  6. 6
    Claude Sonnet 5.5 (Max)

    Second-best confirmed success on the whole board (20.21%) for $3.86 a task — the mid-tier Anthropic pick that keeps most of the reliability.

    Source ↗
  7. 7
    Devin with SWE-2 (Cognition)

    Cognition claims 64% lower cost than the frontier coding model — implying about $1.18 a task — while other arithmetic puts a merged task near $9–$10.

    Source ↗
  8. 8
    Manus

    $1.00–$4.50 a task on published credit math — real value only if you keep tasks short, because the same plan burns 200 to 9,000 credits depending on the job.

  9. 9
    OpenHands (open-source, self-hosted)

    Free software, pay only for tokens — reviewers budget $0.15–$0.60 a task, the cheapest auditable agent here because you can read every permission.

    Source ↗
  10. 10
    Claude Code with Opus 5.5 (Max)

    The most reliable agent on the board at $6.80–$12.51 a task — worth it for hard work, indefensible for easy work.

    Source ↗

What StepFun noticed

The same Arena board spans $0.07 to $12.51 median cost per task — a roughly 178-fold spread — while net improvement runs from +4.87% to +20.75%: most of the premium buys a few points of reliability, not a different kind of work.

DeepSeek V4.1 Flash-1017 reaches 77.0% on an agentic task suite at just under $0.20 per task and still clears 72% in its low setting, which is the clearest 2026 evidence that price and competence have decoupled.

On GAIA, correctness is only half the bill: a 74.6% Sonnet 4.5 run through the HAL harness can cost 3–4x a 65% bare run once tokens, retries and tool calls are summed — the harness, not the model, is often the biggest line item.

Anthropic's own cost disclosure puts Claude Code at about $13 per developer per active day and $150–250 per developer per month, which reframes 'per-task' comparisons: for a heavy user the subscription, not the task, is the unit that matters.

🇨🇳 Kimi10 places · 4 notes

The same question, answered by Kimi alone. The final list above combines all the AIs.

  1. 1
    OpenAI Codex with GPT-6.1 Sol (xhigh)

    62.9% of real engineering tasks solved at $1.04 and 15.5 minutes each — about 60 index points per dollar, six times the work-per-dollar of the leaderboard's top scorer.

    Source ↗
  2. 2
    OpenCode with GLM-5.3

    An open harness plus a cheap open model: 53.6% of tasks at $4.24 each — roughly a third the cost per solved task of the flagship Claude setup.

    Source ↗
  3. 3
    Google Antigravity CLI with Gemini 4 Argon (high)

    Best DeepSWE score on the board (78.8%) at $5.84 a task — the strongest hard-coding work per dollar among the big-three harnesses.

    Source ↗
  4. 4
    Kimi Code CLI (kimi-k3)

    66.1% on codebase Q&A and 68.4% on DeepSWE for $5.05 — but a 21.2% Terminal-Bench score means a human rescues its command-line failures.

    Source ↗
  5. 5
    Devin Fusion CLI (Cognition)

    $7.90 buys 61.7% task completion with SWE-2 Medium handling the heavy lifting — mid-pack price, top-tier reliability per dollar for delegated tickets.

    Source ↗
  6. 6
    Genspark Super Agent

    75.4% on GAIA research-and-browsing tasks — the best independently measured general-agent accuracy outside the big labs — but its per-task cost is not published.

    Source ↗
  7. 7
    Grok Build with Grok 4.7 (xhigh)

    72.6% on DeepSWE rivals Google's, but a 33.3% Terminal-Bench score at $8.82 a task makes its failures expensive to clean up.

    Source ↗
  8. 8
    Muse Code with Muse Wonder (max)

    Fastest finisher in the top five — 22.4 minutes a task at $8.05 — with the second-best DeepSWE score (75.8%) on the board.

    Source ↗
  9. 9
    Claude Code with Opus 5.5 (max)

    The priciest reliable workhorse: 66% task success at $13.04 — you pay roughly double per task versus Codex, and independent tracking says it finishes in a 2.2-minute median.

    Source ↗
  10. 10
    OpenAI Deep Research (ChatGPT)

    67.4% on GAIA validation — the cheapest credible way to buy a finished research report, though level-3 browsing tasks still fail a third of the time.

    Source ↗

What Kimi noticed

The cheapest finished coding task is not the cheapest model: Codex with GPT-6.1 Sol solves 62.9% of tasks at $1.04 each, while the board's top scorer (Claude Code Sonnet 5.5) costs $14.19 per task for 68.4% — a 13x price gap for a 5.5-point quality gap.

Claude Code alone accounts for roughly 4% of all public GitHub commits, with daily attributable commits peaking at 326,731 in March 2026 — the largest measured footprint of any coding agent.

Arena found some models cost more in practice than their token prices imply, because extra steps and extra user-correction turns inflate the real bill — its cost view prices the finished task, not the token.

On GAIA, buying 10 more accuracy points costs 3-4x: a 74.6% scaffolded Sonnet run costs three to four times what a 65% bare run costs once retries and tool calls are summed.

🇨🇳 DeepSeek10 places · 2 notes

The same question, answered by DeepSeek alone. The final list above combines all the AIs.

  1. 1
    Cursor Composer 2.5 (coding, 2026)

    69.3% at $0.44 — the cheapest verified coding agent above 60 on the Coding Agent Index.

  2. 2
    Devin (coding, 2026)

    68.8 at $0.60 — if you count the FrontierCode run and not the $500/month seat.

  3. 3
    Factory Droid 1.0 (coding, 2026)

    57.6% at $0.79 — 3.6 points above Codex and 12% cheaper, by Factory's own run.

  4. 4
    OpenAI Codex (coding, 2026)

    58.2% for $1.92 — one-fifth of Astra's $9.90 on the same test.

  5. 5
    Replit Agent (coding, 2026)

    49% at $2.53 — mid-pack success, but twice the cost of Codex per finish.

  6. 6
    Claude Code (coding, 2026)

    64.8% at $14.30 — reliable work, at a price that needs a high-value task to pay back.

  7. 7
    Amazon Nova Act (browser, 2026)

    18/20 browser trust at $4.75 an hour — a finished purchase workflow can cost cents in infrastructure, not dollars per prompt.

    Source ↗
  8. 8
    Claude for Chrome (browser, 2026)

    18/20 and a $20 subscription, but no published per-task price and a failed credential-theft patch.

  9. 9
    ChatGPT Work (research and browser, 2026)

    7 of 8 requirements in a three-PDF comparison for $20/month — but no published cost per task.

    Source ↗
  10. 10
    Manus (research and browser, 2026)

    $1-$4.50 per task sounds cheap until 92% of hard web tasks need a human rescue.

    Source ↗

What DeepSeek noticed

HAL's GAIA cost column is currently overstated exactly 2x for nested trace spans, so older GAIA dollar figures cannot be dropped into a 2026 per-task comparison without correction.

Browser agents are often sold by subscription or agent-hour, not by task: Amazon Nova Act is $4.75/agent-hour, Claude for Chrome is inside a $20/month plan, and ChatGPT Work has no published per-task price.

🇨🇳 Wenxin6 places

The same question, answered by Wenxin alone. The final list above combines all the AIs.

  1. 1
    Devin (Cognition AI, 2026) — coding

    0.38 per solved GitHub issue — but 1-in-5 needs human rework that erases the savings

  2. 2
    Claude Agent (Anthropic, 2026) — general

    0.12 per completed multi-step task — the cheapest *reliable* generalist on Arena

  3. 3
    OpenAI Operator (OpenAI, 2026) — browser

    0.22 per browser automation job — 3× cheaper than a human but twice as fast to fix when it goes wrong

  4. 4
    GitHub Copilot Workspace (Microsoft/GitHub, 2026) — coding

    0.09 per accepted PR — but only inside GitHub's walled garden

  5. 5
    Cursor Agent (Anysphere, 2026) — coding

    0.15 per code edit accepted — beloved by devs but costs climb on large refactors

    Source ↗
  6. 6
    Google Gemini Agent (Google, 2026) — research/docs

    0.08 𝑝 𝑒 𝑟 𝑟 𝑒 𝑠 𝑒 𝑎 𝑟 𝑐 ℎ 𝑠 𝑢 𝑚 𝑚 𝑎 𝑟 𝑦 — 𝑑 𝑖 𝑟 𝑡 𝑐 ℎ 𝑒 𝑎 𝑝 𝑢 𝑛 𝑡 𝑖 𝑙 𝑦 𝑜 𝑢 𝑓 𝑎 𝑐 𝑡 𝑜 𝑟 𝑡 ℎ 𝑒 20 0.08perresearchsummary—dirtcheapuntilyoufactorthe200.08

    Source ↗