Matched Capabilities, Different Behaviors: A Controlled Study of MCP and CLI Interfaces for Language Agents

Hugging Face Daily Papers Papers

Summary

该论文提出 MICA 与 DART 框架,研究在可执行能力相同的情况下,MCP 与 CLI 接口表示差异如何显著改变语言智能体的行为,并通过针对性修复接口实现提升性能、降低交互成本。

Language agents increasingly act through external tools and interactive environments, making the interface between the model and its executable capabilities part of the decision process. Model Context Protocol (MCP) and command-line interfaces (CLI) can expose the same semantic operations through markedly different model-facing representations. We study whether these representational differences change agent behavior when executable capabilities are matched. We introduce Matched Interface Comparison and Analysis (MICA), which renders MCP and CLI from a shared semantic action contract and routes decoded actions through the same runtime. Across six models and three interactive environments, matched interfaces produce substantial differences in task performance and interaction cost. These effects extend beyond surface validity to semantic action selection, failure pathways, and recovery. Matched-state probes localize sensitivity to capability presentation, realization, and feedback. Paired natural trajectories reveal structured divergence in 94.3% of 2,004 episodes and show that early differences propagate through subsequent interaction. This analysis identifies interface realization as a direct intervention boundary. We therefore introduce Decoupled Action Realization and Targeted Repair (DART), which preserves validated semantic commitments while repairing interface-specific realization. DART improves benchmark score in all six evaluated settings by up to 9.0 points and reduces MCP token cost in all three environments by up to 27.1k tokens per task. Together, these results establish interface representation as part of the closed-loop decision environment shaping agent behavior.
Original Article
View Cached Full Text

Cached at: 10/30/26, 07:12 PM

Paper page - Matched Capabilities, Different Behaviors: A Controlled Study of MCP and CLI Interfaces for Language Agents

Source: https://huggingface.co/papers/2610.34298

Abstract

Matched interface representations significantly alter agent behavior despite identical executable capabilities, and targeted repair of interface-specific realization improves performance while reducing cost.

Language agents increasingly act through external tools and interactive environments, making the interface between the model and its executable capabilities part of the decision process.Model Context Protocol(MCP) and command-line interfaces (CLI) can expose the same semantic operations through markedly different model-facing representations. We study whether these representational differences change agent behavior when executable capabilities are matched. We introduceMatched Interface Comparisonand Analysis (MICA), which renders MCP andCLIfrom a sharedsemantic action contractand routes decoded actions through the same runtime. Across six models and three interactive environments, matched interfaces produce substantial differences in task performance andinteraction cost. These effects extend beyond surface validity to semantic action selection, failure pathways, and recovery.Matched-state probeslocalize sensitivity to capability presentation, realization, and feedback. Paired natural trajectories reveal structured divergence in 94.3% of 2,004 episodes and show that early differences propagate through subsequent interaction. This analysis identifies interface realization as a direct intervention boundary. We therefore introduceDecoupled Action RealizationandTargeted Repair(DART), which preserves validated semantic commitments while repairing interface-specific realization.DARTimproves benchmark score in all six evaluated settings by up to 9.0 points and reduces MCP token cost in all three environments by up to 27.1k tokens per task. Together, these results establish interface representation as part of theclosed-loop decision environmentshaping agent behavior.

View arXiv pageView PDFProject pageGitHub0Add to collection

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2610.34298 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2610.34298 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2610.34298 in a Space README.md to link it from this page.

Collections including this paper1

Similar Articles

Competence-Aware Orchestration for LLM-Based Multi-Agent Systems

arXiv cs.AI

该论文提出了一种两阶段的 competence-aware 框架,用于 LLM 多智能体系统的自动编排,根据模型在当前查询上的能力动态调整角色激活与通信图,在六个基准上平均达到 93.81%,同时在高能力骨干上降低 36.26% 的 token 成本。

RealCLI: Toward a Unified Evaluation of Human-Agent Collaboration for CLI Agents

Hugging Face Daily Papers

The paper introduces REALCLI, a paired benchmark that jointly evaluates CLI agent task execution and human-agent collaboration quality, revealing that frontier agents score only 49.2% on tasks and 37.6% on joint collaboration, with major gaps in steerability, trust calibration, and safety boundary management.