Ran Online-Mind2Web with a local 35B browser agent. Same model, three harness fixes, and a wrong answer became the right one
Summary
作者用单张 3090 上运行的本地 35B 浏览器 agent(Ornith 1.5)在 Online-Mind2Web 上跑了部分任务,通过三轮 harness/清单提示改进将一个错误任务修好,并报告了 30 个新任务的结果:研究类任务表现尚可,UI 操作(下拉框、cookie 遮罩、位置自动补全)是主要失分点。
Similar Articles
@JangLawrenceK: We partnered with Browser-Use to release a new live web eval as a followup to the original Odysseys paper Odysseys2 ser…
Browser-Use partnered with Carnegie Mellon researchers to release Odysseys2, a hard long-horizon live web-agent benchmark built from real user tasks, where the best SOTA agent completes only 47/100 tasks.
Same model, same prompt, two agent harnesses: 45/50 vs 43/50
The article benchmarks two open-source coding agents on the same deepseek-v4-flash model, finding similar task success rates but significant differences in performance metrics and a critical bug in one agent's error handling.
@SunNeverSetsX: Sharing my curated 4 infrastructures that make Agent Loop run faster and better—you must let your agents use them! 1. http://agent-browser.dev Let agents click and verify UI changes in a real browser for true self-closing test loops...
agent-browser is a CLI tool for browser automation designed for AI agents, using compact text output and ref-based element selection to minimize token usage. The post also highlights three other tools—portless, emulate, and ai-cli—for improving agent loop efficiency.
open-source desktop agent app running its agents on local ollama models: two agents on qwen3.5:9b and qwen3.8 on a 16 gb card, real recording, including the limits i hit
Dodaios 的维护者展示了一款 Apache 2.0 开源桌面 AI 代理应用,可在本地 Ollama 模型(Qwen3.5:9b 和 Qwen3.8-16gb)上运行多代理任务,并坦诚说明了本地模型在工具调用上的局限。
What actually breaks agents on a 4B model? Notes from 50 runs on Qwen3.5-4B
A practitioner ran 10 agent harnesses on Qwen3.5-4B across 5 tasks and found that failures came from exact-match edits, literal instruction-following, miscounting, and API mismatches — not malformed tool calls. Six of ten agents passed all tasks, with an 11x spread in run time on identical hardware.