Tag
Ambient Context is a macOS menu bar app that captures text from focused windows into Markdown files for LLMs to read, with privacy redaction and no network calls.
MacOS Harness is a Python tool that enables LLMs to control Mac systems via accessibility features and scripting, offering full control with minimal code.
Technical breakdown of how macOS can support two simultaneous cursors (user and AI agent) via Accessibility API and low-level CGEvent dispatching, enabling background computer use without foreground interruption.
This article explains in detail how to use Accessibility API, CGEvent.postToPid, and event tap technology on macOS to enable an AI agent to operate windows in the background without disturbing the user, thus supporting the coexistence of two mouse pointers.
The article introduces Opendesk, an open-source tool that enhances the reliability of computer-use agents by leveraging native accessibility APIs to identify interactive elements, replacing error-prone pixel-coordinate guessing.