workflow-state

Tag

Cards List
#workflow-state

Auditing Escalation Reliability in Healthcare LLM Agents: A Perturbation-Controlled Benchmark of Workflow-State Failures

arXiv cs.AI ↗ · 2026-10-16 Cached

该论文提出了一个受扰动控制的医疗LLM智能体基准测试,包含400个多轮episode,评测在缺失、过时、冲突和迟到信息下的升级/拒答决策能力。结果显示模型在干净环境下准确率达0.97,但在不确定性扰动下漏掉32-97%的必要升级,且基于词汇规则的控制器在未见过的同义改写下召回率降至0。

0 favorites 0 likes
← Back to home

Submit Feedback