@FinanceYF5: 1/ Jev + Mercury 2.5 nearly "punched through" the WebMCP benchmark: All 49/49 tasks completed. Model cost is approximat…
Summary
Jev + Mercury 2.5 AI model completed all tasks on the WebMCP benchmark with significantly lower cost compared to GPT-6 Astra variants.
View Cached Full Text
Cached at: 09/20/26, 11:12 AM
1/ Jev + Mercury 2.5 nearly “punched through” the WebMCP benchmark:
All 49/49 tasks completed.
Model cost is approximately 112 times lower than GPT-6 Astra with code execution, and approximately 245 times lower than Astra using screenshot-operated browser. 👇
2/ Jev 单独通过浏览器 DOM 操作时,只完成了 25/49 项任务。
接入 WebMCP 后,成绩直接提升到 49/49,成功任务数量接近翻倍,同时模型成本又降低了 18%。
真正改变结果的,是 Agent 与网站交互的方式。
3/ 这套组合的分工非常简单:
Jev 负责选择工具。
Mercury 2.5 负责生成搜索词等工具参数。
WebMCP 负责把网站功能变成清晰、可直接调用的工具。
4/ Jev 可以从一组离散选项中做选择,但无法生成任意文本。
例如,它可以选择 search_products 工具,却无法自己生成具体的搜索词。
因此需要 Mercury 2.5 补充参数。它每秒可输出 1000 多个 Token,速度快、成本低。
5/ 为什么接入 WebMCP 后效果提升这么明显?
因为多数任务真正困难的部分,是选择正确的下一步,而不是生成工具参数。
WebMCP 把一连串点击、填表、菜单跳转,压缩成一次明确的工具调用,大幅减少了决策空间。
6/25/49 It’s just that this Ultrafast implementation, in the current benchmark tests, the results do not represent the upper limit of Jev or Browser Use’s capabilities.
The full tests and methods have been open-sourced and are reproducible:
https://webmcp.com/benchmark https://github.com/nekuda-ai/WindTunnel… https://github.com/browser-use/jev-ultrafast…
Read the original text
Exa has built a “time machine” for the internet.
Exa Snapshot indexes 400 billion web page historical snapshots, allowing people to search the web as if they were in the past.
It has been used for predictive model backtesting, reinforcement learning in AI labs, and exploring the internet before the advent of AI.
Similar Articles
I benchmarked Jev against gpt-5.6-luna!
The article presents a benchmark comparison showing that Jev outperforms gpt-5.6-luna on 42 of 49 tasks with lower latency and cost, though it has limitations in text generation and certain reasoning aspects.
@FinanceYF5: GPT-6 Astra is taking the internet by storm. Playing Minecraft, designing proteins, tracking sports events, building 3D…
GPT-6 Astra, an AI model, is viral for its diverse applications in gaming, protein design, sports tracking, and 3D world building, highlighted by 10 stunning cases.
Gpt 6 astra benchmarks
This article covers the benchmarks for OpenAI's GPT-6 model, evaluating its performance using the Astra benchmark system.
@FinanceYF5: GPT-6 Astra "disassembles" a V8 engine, turning it into an interactive 3D classroom. Someone simply asked it to create …
GPT-6 Astra demonstrates its advanced capabilities by generating an interactive 3D visualization of a V8 engine, allowing users to explore its components and four-stroke cycle in real-time for educational purposes.
@10xmylife: Tried it out today, and it really works, so we'll go with this plan.
A user tested the Jev model's performance in the game 'Slay the Spire 2', where its decision-making speed was extremely fast, taking only 0.7 seconds, far surpassing humans and GPT-6 Astra, which is astonishing.