Tag
The paper treats LLM Agents as an Operating System (AaOS), systematically surveying 116 mechanisms across 19 subsystems against standard OS textbooks. It finds only 11 are isomorphic, while 65 are missing — including privilege separation, resource quotas, and tamper-proof auditing. Experiments on Claude Code, Codex CLI, and Gemini CLI further demonstrate that per-tool protections can be bypassed via the shell, and forged session logs can be accepted upon recovery, pointing to the need for a non-bypassable monitoring layer outside the model.
RealCLI是一个成对基准,统一评估CLI代理的任务执行与人机协作质量,通过五维框架和脚本化用户模拟渐进式交互。结果显示前沿代理能力差距明显,最佳配置平均得分仅49.2%,协作分数峰值仅37.6%。
The paper introduces REALCLI, a paired benchmark that jointly evaluates CLI agent task execution and human-agent collaboration quality, revealing that frontier agents score only 49.2% on tasks and 37.6% on joint collaboration, with major gaps in steerability, trust calibration, and safety boundary management.
Munder Difflin is an open-source multi-agent harness that enables users to deploy AI agent clones for 24/7 automation and team collaboration, integrating with existing CLI agents and providing private cloud and network features.
The paper introduces DCAS, a backend-substitution interception layer that decouples CLI agent scaffolding from backend models, enabling cross-scaffold evaluation. It shows that planning-aware fine-tuning on a small dataset improves model generalization across non-training scaffolds.
The author shares their project The Termi Protocol, a desktop app that gives each CLI agent a visual body in a cozy 3D room and connects them into a hive with a central queen brain for unified history and coordination.
ECHO introduces a hybrid objective that combines policy-gradient loss with environment observation prediction to provide dense supervision from terminal feedback, doubling performance on TerminalBench-2.0 for Qwen3 models.
Superset is an open-source IDE for orchestrating multiple CLI-based AI coding agents in parallel, with isolated git worktrees, built-in monitoring, and a diff viewer. It supports various agents like Claude Code, Codex CLI, and Gemini CLI.
ECHO is a new, simple, and free method that addresses CLI agents, continual learning, self-improvement, and world models.
The author shares their experience building an AI agent infrastructure using Rocket.Chat, CLI agents, and tmux, scaling to 250 clients to help them build websites. They pivoted from selling a service to teaching clients to use agents themselves, emphasizing the importance of context management in such systems.