@FinanceYF5: 1/ Jev + Mercury 2.5 nearly "punched through" the WebMCP benchmark: All 49/49 tasks completed. Model cost is approximat…

X AI KOLs Following Models

Summary

Jev + Mercury 2.5 AI model completed all tasks on the WebMCP benchmark with significantly lower cost compared to GPT-6 Astra variants.

1/ Jev + Mercury 2.5 nearly "punched through" the WebMCP benchmark: All 49/49 tasks completed. Model cost is approximately 112 times lower than GPT-6 Astra with code execution, and approximately 245 times lower than Astra using screenshot-operated browser.
Original Article
View Cached Full Text

Cached at: 09/20/26, 11:12 AM

1/ Jev + Mercury 2.5 nearly “punched through” the WebMCP benchmark:

All 49/49 tasks completed.

Model cost is approximately 112 times lower than GPT-6 Astra with code execution, and approximately 245 times lower than Astra using screenshot-operated browser. 👇

2/ Jev 单独通过浏览器 DOM 操作时,只完成了 25/49 项任务。

接入 WebMCP 后,成绩直接提升到 49/49,成功任务数量接近翻倍,同时模型成本又降低了 18%。

真正改变结果的,是 Agent 与网站交互的方式。

3/ 这套组合的分工非常简单:

Jev 负责选择工具。

Mercury 2.5 负责生成搜索词等工具参数。

WebMCP 负责把网站功能变成清晰、可直接调用的工具。

4/ Jev 可以从一组离散选项中做选择,但无法生成任意文本。

例如,它可以选择 search_products 工具,却无法自己生成具体的搜索词。

因此需要 Mercury 2.5 补充参数。它每秒可输出 1000 多个 Token,速度快、成本低。

5/ 为什么接入 WebMCP 后效果提升这么明显?

因为多数任务真正困难的部分,是选择正确的下一步,而不是生成工具参数。

WebMCP 把一连串点击、填表、菜单跳转,压缩成一次明确的工具调用,大幅减少了决策空间。

6/25/49 It’s just that this Ultrafast implementation, in the current benchmark tests, the results do not represent the upper limit of Jev or Browser Use’s capabilities.

The full tests and methods have been open-sourced and are reproducible:

https://webmcp.com/benchmark https://github.com/nekuda-ai/WindTunnel… https://github.com/browser-use/jev-ultrafast…

Read the original text

Exa has built a “time machine” for the internet.

Exa Snapshot indexes 400 billion web page historical snapshots, allowing people to search the web as if they were in the past.

It has been used for predictive model backtesting, reinforcement learning in AI labs, and exploring the internet before the advent of AI.

Similar Articles

I benchmarked Jev against gpt-5.6-luna!

Reddit r/ArtificialInteligence

The article presents a benchmark comparison showing that Jev outperforms gpt-5.6-luna on 42 of 49 tasks with lower latency and cost, though it has limitations in text generation and certain reasoning aspects.

Gpt 6 astra benchmarks

Reddit r/singularity

This article covers the benchmarks for OpenAI's GPT-6 model, evaluating its performance using the Astra benchmark system.