兄弟们！ 不要重复造轮子，直接拿这个31.4K Star的开源来干吧！ 字节跳动把 UI-TARS-desktop 开源了，看了一眼，这个项目已经上线快一年了！ 目前 Star 数已经来到 31.4k，而且增长速度还挺稳。 24 小时增长日榜第一！ 这是一个原生的桌面 GUI Agent，你直接装在电脑上就能用自然语言指挥它操作各种应用。 核心就是靠截屏 + 视觉模型看懂当前屏幕，然后精准控制鼠标和键盘。 想象一下，你直接跟它说“帮我打开 VS Code 把自动保存打开”，或者“去 GitHub 看下这个 issue”，它就能自己截屏、识别界面、点按钮、输入文字，整个过程全在本地跑，数据一点都不往外传，隐私完全自己掌握。 它支持 Windows 和 macOS，还能操作浏览器，既可以控制本地电脑，也支持远程电脑和浏览器模式。 项目里自带 SDK，开发者想基于它搭自己的自动化工具也特别方便。 最近他们更新到 v0.3.0，CLI 命令行版本也更成熟了，带流式输出和时间统计，用起来更顺手。 想玩的同学可以直接去仓库看 quick-start 文档，几步就能跑起来本地操作。 感觉本地桌面 Agent 这条路又多了一个实打实的靠谱选择。 原项目：https://github.com/bytedance/UI-TARS-desktop… 想试的同学可以去仓库 star 一下，支持一下。

bytedance/UI-TARS-desktop

Source: https://github.com/bytedance/UI-TARS-desktop

Introduction

English | 简体中文

TARS^* is a Multimodal AI Agent stack, currently shipping two projects: Agent TARS and UI-TARS-desktop:

Table of Contents

• News
• Agent TARS
  • Showcase
  • Core Features
  • Quick Start
  • Documentation
• UI-TARS Desktop
  • Showcase
  • Features
  • Quick Start
• Contributing
• License
• Citation

News

• [2025-11-05] 🎉 We’re excited to announce the release of Agent TARS CLI v0.3.0! This version brings streaming support for multiple tools (shell commands, multi-file structured display), runtime settings with timing statistics for tool calls and deep thinking, Event Stream Viewer for data flow tracking and debugging. Additionally, it features exclusive support for AIO agent Sandbox as isolated all-in-one tools execution environment.
• [2025-06-25] We released an Agent TARS Beta and Agent TARS CLI - Introducing Agent TARS Beta, a multimodal AI agent that aims to explore a work form that is closer to human-like task completion through rich multimodal capabilities (such as GUI Agent, Vision) and seamless integration with various real-world tools.
• [2025-06-12] - 🎁 We are thrilled to announce the release of UI-TARS Desktop v0.2.0! This update introduces two powerful new features: Remote Computer Operator and Remote Browser Operator—both completely free. No configuration required: simply click to remotely control any computer or browser, and experience a new level of convenience and intelligence.
• [2025-04-17] - 🎉 We’re thrilled to announce the release of new UI-TARS Desktop application v0.1.0, featuring a redesigned Agent UI. The application enhances the computer using experience, introduces new browser operation features, and supports the advanced UI-TARS-1.5 model for improved performance and precise control.
• [2025-02-20] - 📦 Introduced UI TARS SDK, is a powerful cross-platform toolkit for building GUI automation agents.
• [2025-01-23] - 🚀 We updated the Cloud Deployment section in the 中文版: GUI模型部署教程 with new information related to the ModelScope platform. You can now use the ModelScope platform for deployment.

Agent TARS

Agent TARS is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.

It primarily ships with a CLI and Web UI for usage. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world MCP tools.

Showcase

Please help me book the earliest flight from San Jose to New York on September 1st and the last return flight on September 6th on Priceline

https://github.com/user-attachments/assets/772b0eef-aef7-4ab9-8cb0-9611820539d8

For more use cases, please check out #842.

Core Features

• 🖱️ One-Click Out-of-the-box CLI - Supports both headful Web UI and headless server execution.
• 🌐 Hybrid Browser Agent - Control browsers using GUI Agent, DOM, or a hybrid strategy.
• 🔄 Event Stream - Protocol-driven Event Stream drives Context Engineering and Agent UI.
• 🧰 MCP Integration - The kernel is built on MCP and also supports mounting MCP Servers to connect to real-world tools.

Quick Start

# Launch with `npx`.
npx @agent-tars/cli@latest

# Install globally, required Node.js >= 22
npm install @agent-tars/cli@latest -g

# Run with your preferred model provider
agent-tars --provider volcengine --model doubao-1-5-thinking-vision-pro-250428 --apiKey your-api-key
agent-tars --provider anthropic --model claude-3-7-sonnet-latest --apiKey your-api-key

Visit the comprehensive Quick Start guide for detailed setup instructions.

Documentation

🌟 Explore Agent TARS Universe 🌟

Category	Resource Link	Description
🏠 Central Hub		Your gateway to Agent TARS ecosystem
📚 Quick Start		Zero to hero in 5 minutes
🚀 What's New		Discover cutting-edge features & vision
🛠️ Developer Zone		Master every command & features
🎯 Showcase		View use cases built by the official and community
🔧 Reference		Complete technical reference

UI-TARS Desktop

UI-TARS Desktop is a native GUI agent for your local computer, driven by UI-TARS and Seed-1.5-VL/1.6 series models.

Showcase

Features

• 🤖 Natural language control powered by Vision-Language Model
• 🖥️ Screenshot and visual recognition support
• 🎯 Precise mouse and keyboard control
• 💻 Cross-platform support (Windows/MacOS/Browser)
• 🔄 Real-time feedback and status display
• 🔐 Private and secure - fully local processing

Quick Start

See Quick Start

Contributing

See CONTRIBUTING.md.

License

This project is licensed under the Apache License 2.0.

Citation

If you find our paper and code useful in your research, please consider giving a star :star: and citation :pencil:

@article{qin2025ui,
  title={UI-TARS: Pioneering Automated GUI Interaction with Native Agents},
  author={Qin, Yujia and Ye, Yining and Fang, Junjie and Wang, Haoming and Liang, Shihao and Tian, Shizuo and Zhang, Junda and Li, Jiahao and Li, Yunxin and Huang, Shijue and others},
  journal={arXiv preprint arXiv:2501.12326},
  year={2025}
}