Tag
The author criticizes browser agents for frequently failing due to login screens and other disruptions, recommending the use of proper APIs or native connectors like those in Runable for more reliable automation.
Wuying-Browser-Agent is a unified framework for real-world long-horizon browser agents, introducing BrowserBench benchmark and achieving state-of-the-art performance on web-use tasks.
The article discusses challenges in training browser-agent models for sequential decision-making, such as error recovery and memory, and seeks input on optimizing training objectives. The author mentions working on the 'mako' model at tinyfish and invites community feedback.
The author shares design decisions for Panerelay, an open-source project that lets AI agents control a real Chrome profile, separating permissions like site access, tab selection, and control leases, and asks the community for feedback on authorization boundaries.
The author is building a tool for AI browser agents to detect and handle website drift and seeks feedback from users on pain points and existing solutions.
A developer benchmarks Rote, a memory manager for browser agents that sends page diffs instead of full re-renders, showing a 37% reduction in token growth compared to Browser Use, but with trade-offs on short tasks.
Webcmd is an open-source tool that teaches browser agents to learn site navigation once and reuse it, dramatically reducing token waste on repetitive tasks. It supports 99 sites and runs locally.
Microsoft AI Frontiers releases a family of browser agents that can fill forms and make reservations using pixel-to-action with observe-think-act loops. Available in 4B, 9B, and 27B parameter sizes for deployment on modest hardware.
Learn how to build AI agents that can interact with the browser.
The author argues that AI agents fail on real web tasks not because models are weak, but because browsers are designed for humans and lack isolated, scriptable workspaces for agent use.
The article critiques current browser AI agents for inefficiency due to repeatedly parsing and reasoning about the same websites, and proposes a model where agents reuse proven interaction paths to reduce token consumption and improve speed.
Microsoft introduces the Fara1.5 family of small browser agents (4B, 9B, 27B) that achieve state-of-the-art performance on computer use benchmarks, scoring 63% on Online-Mind2Web and beating larger models like Operator and Gemini.
The author explains why they stopped using browser-based LLM agents to browse Hacker News, and built a plugin (MediaUse) that fetches structured data directly, saving tokens and focusing the model on analysis rather than navigation.
Discusses architectural issues with current browser agents using headless Chrome + AI layer, and presents Opera Neon's CLI as an alternative where AI is integrated into the browser, reducing token overhead and improving understanding.
The author observes that browser agents have evolved from flashy demos to reliably performing tasks like research, updating sheets, and completing workflows, marking a shift from assistants to operators.
This paper demonstrates that websites can identify which large language model powers a browsing agent by analyzing its behavioral patterns and timing data, achieving up to 96% F1 score across 14 frontier LLMs. It formalizes this attack surface and shows that random timing delays are insufficient to prevent identification.