Tag
An open-source recipe shows multi-turn agentic RL training Gemma 4 E2B on a single Google TPU, boosting win rate on a tool-calling board game from 9.4% to 95% after 100 GRPO steps.
论文提出 M³,一个将多轮越狱形式化为有限时域马尔可夫决策过程(MDP)的自动化红队框架,在两个基准、六个目标模型上将攻击成功率(ASR@5)提升最高达 53%,显著优于现有黑盒多轮红队方法。
OmicsBench introduces a long-horizon, multi-turn benchmark of 97 DAG-structured bioinformatics tasks (662 subtasks) for evaluating AI agents over research-study-scale workflows, revealing significant performance gaps and introducing an unsupervised failure mode discovery pipeline.
This paper proposes amortizing sequential Bayesian experimental design into LLMs by training the reasoning that guides action selection with information-gain rewards. Trained on Twenty Questions, the resulting policies outperform training- and inference-time BED baselines at lower cost, generalize to unseen categories, and transfer to the Medi-Q clinical dialogue benchmark.
TreeHCA 提出将后见比率引导的探索与后见信用分配耦合,通过参考答案似然变化重建中间历史并生成替代续写,形成推理与工具交互树,并用归一化树回传将终局结果传播为回合级优势,在七个问答基准和三个 Qwen 主干上超越所有基线。
本文提出MIMESIS,一个基于真实用户对话与显式推理监督训练的专用用户模拟器(9B模型),在行为保真度上超越前沿模型;研究还将该模拟器冻结后用于多轮强化学习训练智能体,并提出Coached On-Policy Self-Distillation(CSD)方法,在九个未见用户模拟器上实现更强泛化性能。
AdviSD proposes a method where a small trainable advisor steers a frozen frontier LLM executor via targeted multi-turn self-distillation, pairing outcome-based RL with feedback-conditioned self-distillation that selectively uses corrections. Experiments with Qwen3-8B advisors guiding Gemini and Claude show 4-6 point gains on BFCL-v3 and EnvScaler with good out-of-domain generalization.
MURPHY introduces a feedback-aware multi-turn extension of GRPO for self-correcting code generation, improving performance on benchmarks by crediting earlier attempts that provide feedback for later successes.
This paper proposes MT-OPSD, a non-policy self-distillation framework to address degradation in multi-turn image editing and introduces LME-Bench for evaluating long-horizon robustness.
This paper introduces IntentFlux, an executable benchmark for measuring intent drift in multi-turn LLM agents, and StateForge, an explicit active-requirement maintenance method that partially improves task scores when users change their minds mid-dialogue.
Introduces PII-TRACE, the first benchmark for context-aware PII detection in multi-turn LLM conversations, and PII-Tracer, a compact detector that achieves high entity-level coverage.
This paper diagnoses the gap between next-turn evaluation metrics and autonomous workflow execution success for AI agents, showing that supervised fine-tuning improves turn-level performance but fails to enhance end-to-end workflow success.
The paper introduces τ-Elicitation, a benchmark for evaluating multi-turn entity extraction in voice agents, identifying strategy selection and error recovery as key bottlenecks.
SCX Router introduces a lightweight GLiClass-based model selection tool that uses a decoder-KV classifier and a task ontology to route LLM tasks, optimizing for speed, cost, and quality without autoregressive generation.
PGPO proposes potential-guided policy optimization for multi-turn agentic tasks, enabling finer-grained credit assignment in LLM post-training and showing strong results on ALFWorld and WebShop benchmarks.
EvoGenUI-Bench introduces a benchmark for evaluating LLMs as multi-turn generative UI assistants, focusing on interface maintenance across 150 tasks with challenges in state propagation and external grounding.
Proposes HiDiffTIR, a hierarchical difficulty-aware policy optimization framework for multi-turn tool-integrated reasoning in LLM agents, improving performance and tool invocation accuracy through fine-grained credit assignment.
This paper introduces Multi-Turn Certified Robustness (MTCR), a framework for certifying the safety of large language models against multi-turn jailbreak attacks by providing tighter bounds through compositional methods and safety persistence.
OmniAssistBench is a benchmark for evaluating omni-modal large language models as real-time video assistants, revealing that current models struggle with visual prompts, context retention, and timely responses.
DART-SD proposes a topology-aware retrieval and tuning framework for self-distillation of LLM-based tool-calling agents, improving policy diversity by correcting only critical topological breakpoints while preserving valid reasoning.