Native computer-use app for driving autonomous work

Reddit r/AI_Agents Tools

Summary

Vantage is an open-source Windows 11 app that turns a typed prompt into autonomous desktop actions, using AI models to read actual window text via UI Automation, click, type, and run PowerShell rather than relying on screenshots. It brings your own API key for any OpenAI-compatible provider, stores everything locally, and is an early-stage project still seeking failure-case feedback.

I’ve built Vantage, an open-source Windows 11 app where you type a task in a chat box and an AI model carries it out on your actual desktop: it looks at the screen, clicks and types, reads windows through Windows UI Automation, and can run PowerShell. In one test, a single prompt had it open seven Wikipedia articles in Edge, read figures from each infobox, convert them in Calculator’s Length converter, save a file per mountain in Notepad, read system details from Settings, and write a sorted summary, which took 80 steps and about 8 minutes with Gemini 3.8 Flash. I focused on making it read rather than guess, so it reads the window’s actual text instead of relying on screenshots and won’t type a number it hasn’t read. It also does tasks the way you ask, so “use Calculator” means Calculator, and it doesn’t touch your open browser tabs or your clipboard. You bring your own API key for any OpenAI-compatible provider whose model accepts images, and everything is stored locally with API keys encrypted by Windows DPAPI. It’s Windows only and still early, it acts without asking before each step, and how well it does depends a lot on the model, so I’d love to hear which tasks it fails on. The demo, source and installer are linked in the comments.
Original Article

Similar Articles

Open-Source computer-use agent

Reddit r/ArtificialInteligence

Vantage is an open-source Windows app that uses an LLM to automate desktop tasks via natural language, enabling users to drive any desktop app with plain English commands.

vantage.ai

Product Hunt

Vantage is a free, open-source tool that monitors and controls the usage and costs of AI coding agents, offering session logs and guardrails.

I built a computer-use AI you can actually install and start using in minutes

Reddit r/AI_Agents

Arvik is a beta computer-use AI assistant for Windows and Android that simplifies setup and allows natural language instructions for automation tasks like website interaction, file management, and system commands. The developer is seeking feedback from users to improve its reliability and functionality.

vercel-labs/agent-desktop

GitHub Trending (daily)

Vercel Labs released agent-desktop, an open-source CLI and C library that lets AI agents read and operate macOS, Windows, and Linux desktop apps via the OS accessibility tree, using JSON snapshots with element refs instead of pixel matching.

Microsoft Copilot

Product Hunt

Microsoft Copilot is an AI assistant built for work, connecting existing tools with AI capabilities to help users create finished work.