Matched Capabilities, Different Behaviors: A Controlled Study of MCP and CLI Interfaces for Language Agents
Summary
该论文提出 MICA 与 DART 框架,研究在可执行能力相同的情况下,MCP 与 CLI 接口表示差异如何显著改变语言智能体的行为,并通过针对性修复接口实现提升性能、降低交互成本。
View Cached Full Text
Cached at: 10/30/26, 07:12 PM
Paper page - Matched Capabilities, Different Behaviors: A Controlled Study of MCP and CLI Interfaces for Language Agents
Source: https://huggingface.co/papers/2610.34298
Abstract
Matched interface representations significantly alter agent behavior despite identical executable capabilities, and targeted repair of interface-specific realization improves performance while reducing cost.
Language agents increasingly act through external tools and interactive environments, making the interface between the model and its executable capabilities part of the decision process.Model Context Protocol(MCP) and command-line interfaces (CLI) can expose the same semantic operations through markedly different model-facing representations. We study whether these representational differences change agent behavior when executable capabilities are matched. We introduceMatched Interface Comparisonand Analysis (MICA), which renders MCP andCLIfrom a sharedsemantic action contractand routes decoded actions through the same runtime. Across six models and three interactive environments, matched interfaces produce substantial differences in task performance andinteraction cost. These effects extend beyond surface validity to semantic action selection, failure pathways, and recovery.Matched-state probeslocalize sensitivity to capability presentation, realization, and feedback. Paired natural trajectories reveal structured divergence in 94.3% of 2,004 episodes and show that early differences propagate through subsequent interaction. This analysis identifies interface realization as a direct intervention boundary. We therefore introduceDecoupled Action RealizationandTargeted Repair(DART), which preserves validated semantic commitments while repairing interface-specific realization.DARTimproves benchmark score in all six evaluated settings by up to 9.0 points and reduces MCP token cost in all three environments by up to 27.1k tokens per task. Together, these results establish interface representation as part of theclosed-loop decision environmentshaping agent behavior.
View arXiv pageView PDFProject pageGitHub0Add to collection
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2610.34298 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2610.34298 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2610.34298 in a Space README.md to link it from this page.
Collections including this paper1
Similar Articles
@Smartpigai: https://x.com/Smartpigai/status/2091446028537061629
This article analyzes the trend of AI Agents shifting from MCP to CLI, discusses the advantages of CLI in local execution, context saving, and debugging, and points out the potential future division of labor between MCP and CLI.
RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents
RealCLI是一个成对基准,统一评估CLI代理的任务执行与人机协作质量,通过五维框架和脚本化用户模拟渐进式交互。结果显示前沿代理能力差距明显,最佳配置平均得分仅49.2%,协作分数峰值仅37.6%。
Competence-Aware Orchestration for LLM-Based Multi-Agent Systems
该论文提出了一种两阶段的 competence-aware 框架,用于 LLM 多智能体系统的自动编排,根据模型在当前查询上的能力动态调整角色激活与通信图,在六个基准上平均达到 93.81%,同时在高能力骨干上降低 36.26% 的 token 成本。
@akshay_pachaar: The MCP vs CLI debate. For most of 2025, AI Engineers argued about it. The skeptics had real numbers: - Playwright MCP …
Anthropic's 'Code Mode' reframes the MCP vs CLI debate by having AI agents write code to call tools via a runtime rather than loading full schemas into context, drastically reducing token usage. This approach combines MCP's typed contracts with lazy loading, proving the protocol is evolving rather than dying.
RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents
The paper introduces REALCLI, a paired benchmark that jointly evaluates CLI agent task execution and human-agent collaboration quality, revealing that frontier agents score only 49.2% on tasks and 37.6% on joint collaboration, with major gaps in steerability, trust calibration, and safety boundary management.