I found an interesting open-source automation AI tool on GitHub: Terminator. Instead of relying on OCR to “see” the screen, it directly “reads” the application structure—like parsing HTML in a web page—making it faster and more accurate at controlling various software on your computer. Compared to traditional OCR-based automation tools, its advantages are clear:

• Faster: More than just a marginal speed boost
• Works even when obscured: Can still interact with windows that are in the background or covered by other windows
• More stable: Small UI changes are less likely to break your workflows

Project link: https://github.com/mediar-ai/terminator

Currently supports Windows primarily; macOS only has partial functionality. If you want to automate tasks on your desktop and understand the underlying implementation logic, this project is worth checking out.

mediar-ai/terminator

Source: https://github.com/mediar-ai/terminator

Demo

Computer Use MCP that controls your entire desktop

Give AI assistants (Claude, Cursor, VS Code, etc.) the ability to control your desktop and automate tasks across any application.

Claude Code (one-liner):

claude mcp add terminator "npx -y terminator-mcp-agent@latest"

Other clients (Cursor, VS Code, Windsurf, etc.):

Add to your MCP config file:

{
  "mcpServers": {
    "terminator-mcp-agent": {
      "command": "npx",
      "args": ["-y", "terminator-mcp-agent@latest"],
      "env": {
        "LOG_LEVEL": "info",
        "RUST_BACKTRACE": "1"
      }
    }
  }
}

See the MCP Agent README (https://github.com/mediar-ai/terminator/tree/main/terminator-mcp-agent) for detailed setup instructions.

Why Terminator MCP?

• Uses your browser session - no need to relogin, keeps all your cookies and auth
• Doesn’t take over your cursor or keyboard - runs in the background without interrupting your work
• Works across all dimensions - pixels, DOM, and Accessibility tree for maximum reliability

Use Cases

• Create a new instance on GCP, connect to it using CLI
• Check logs on Vercel to find most common errors
• Test my app new features based on recent commits

What’s new

• 01/09/26 - Mediar IDE (Cursor for Windows automation) is in public access - download now (https://cdn.crabnebula.app/download/mediar/mediar/latest/platform/windows-x86_64)
• 10/30 Public alpha is live - Cursor for Windows automation (https://www.mediar.ai)
• 09/26 Terminator was on Cohere Labs podcast (https://www.youtube.com/watch?v=cfQxlk8KNmY), also check the slides (https://092025-cohere.mediar.ai/)
• 08/25 Big release — NodeJS SDK in YAML workflows, run JS in browser, OS event recording → YAML generation in MCP, and more
• 08/25 we raised $2.8m to give AI hands to every desktop (https://x.com/louis030195/status/1948745185178914929)

Why Terminator

For Developers

• Create automations that work across any desktop app or browser
• Runs 100x faster than ChatGPT Agents, Claude, Perplexity Comet, BrowserBase, BrowserUse (deterministic, CPU speed, with AI recovery)

• 95% success rate unlike most computer use overhyped products

• MIT-licensed — fork it, ship it, no lock-in

We achieve this by pre-training workflows as deterministic code, and calling AI only when recovery is needed.

For Teams

Our public beta workflow builder (https://www.mediar.ai) + managed hosting:

• Record, map your processes, and implement the workflow without technical skills
• Deploy AI to execute them at >95% success rate without managing hundreds of Windows VMs
• Kill repetitive work without legacy RPA complexity, implementation and maintenance cost

Feature Support

Terminator currently supports Windows only. macOS and Linux are not supported.

Legend:

• Yes: Supported - The feature is stable and well-tested.
• Partial: Partial / Experimental - The feature is in development and may have limitations.
• No: Not available on this platform.

How to Inspect Accessibility Elements (like name:Seven)

To create reliable selectors (e.g. name:Seven, role:Button, window:Calculator), you need to inspect the Windows Accessibility Tree:

Windows

• Tool: Accessibility Insights for Windows (https://accessibilityinsights.io/downloads/)
• Alt: Inspect.exe (https://learn.microsoft.com/en-us/windows/win32/winauto/inspect-objects) (comes with Windows SDK)
• Usage: Open the app you want to inspect → launch Accessibility Insights → hover or use keyboard navigation to explore the UI tree (Name, Role, ControlType, AutomationId).

These tools show you the Name, Role, ControlType, and other metadata used in Terminator selectors.

Platform Support

Note: Terminator currently supports Windows only. macOS and Linux support is not available.

Troubleshooting

For detailed troubleshooting, debugging, and MCP server logs, send us a message (https://www.mediar.ai/).

Contributing

Contributions are welcome! Please feel free to submit issues and pull requests. many parts are experimental, and help is appreciated.