Tag
A user describes a CLI tool that controls the entire desktop via hybrid mouse, keyboard, and screenshot methods, successfully performing tasks like sending email screenshots and remote desktop control. They seek challenging tests to validate its robustness.
MountainDesk is a local-first tool that bridges AI model inference with desktop automation, offering features like system state anchors, multi-agent orchestration, and background monitoring. The creator seeks feedback on security and workflow integration.
Teknium introduces an early preview of Computer Use built into the Hermes Agent and powered by TryCua, enabling any AI model to interact with and control a desktop environment in the background without overriding direct user input.
将 Hermes Agent 与 AionUI 结合，可将个人电脑升级为支持多智能体并行、具备长期记忆与自我进化能力的 Agentic AI 操作系统，实现从数据分析、文件管理到代码编写的全自动化本地工作流。
The article introduces Opendesk, an open-source tool that enhances the reliability of computer-use agents by leveraging native accessibility APIs to identify interactive elements, replacing error-prone pixel-coordinate guessing.
ByteDance's open-source desktop AI automation tool, UI-TARS Desktop, supports local execution and screen visual understanding. It can autonomously control your computer to handle daily tasks through natural language commands.
UI-TARS-desktop is a highly popular open-source tool by ByteDance that enables 100% local multimodal desktop automation, allowing users to control apps and browsers via natural language without cloud data leaks.
China has open-sourced a desktop AI agent that can see the screen and control mouse/keyboard via natural language, running entirely locally without cloud dependency.
Roundtable Space is a fully local, open-source desktop automation agent that uses natural language to control screens, mice, and keyboards across applications, rapidly accumulating over 29k GitHub stars.
OpenAI's new ChatGPT feature allows it to directly control browsers and desktop applications, enabling automated tasks like form filling and data entry.
pi-computer-use is an extension for Pi agents that enables them to view and interact with desktop applications on macOS and Windows by clicking, typing, scrolling, and waiting for UI changes.