I built agent-browser but for OS automation.

Reddit r/AI_Agents Tools

Summary

The author introduces agent-ctrl, an open-source Rust-based CLI tool for OS automation that allows AI agents to interact with native application UIs via accessibility trees.

Hey r/AI_Agents ! I was using agent-browser to power my agentic workflow, and it worked great. When I wanted to expand computer-use to the OS itself, I couldn't find a good enough tool that was open-source, so I decided to build it myself. **What is agent-ctrl?** agent-ctrl is an OS automation CLI for AI agents written in Rust for speed. **How does it work?** agent-ctrl turns native app UIs into agent-readable format, then letting you or your agent act upon UIs. It flattens and parses accessibility trees from any OS into one schema, which allows for cross-OS agents. For now it supports Windows, I'm working on MacOS and Linux right now. Looking for people open to contribute for Linux, since I do not run it myself.
Original Article

Similar Articles

Open Browser Use

Product Hunt

Open Browser Use is an open-source tool for browser automation designed for local AI agents.

I gave your agent access to Firefox - meet Firefox CLI

Reddit r/artificial

A new CLI tool, Firefox CLI, allows AI agents to control a real Firefox browser session, providing a Firefox equivalent of Agent Browser with improvements like permanent extension installation and separate windows for agents.