intent-tracking

Tag

Cards List
#intent-tracking

You Changed Your Mind, The Model Didn't: Demystifying Intent in Multi-Turn Dialogue

Hugging Face Daily Papers ↗ · 2026-10-05 Cached

该论文提出了 Intent-Eval 基准来系统研究大语言模型在多轮对话中追踪用户意图变化的能力,发现模型会将已被拒绝或替换的提议误当作有效要求(mentioned-as-in-effect 混淆),并提出 Intent-OPSD(基于决策的在策略自蒸馏框架)来提升模型对活跃意图的遵循能力。

0 favorites 0 likes
#intent-tracking

Enjoy Your Talk: A Human-Centered Benchmark for Multi-Turn Dialogue with Decoupled User Simulation, Target Modeling, and Judging

arXiv cs.CL ↗ · 2026-07-14 Cached

This paper introduces EYT-Bench, a human-centered benchmark for evaluating LLMs in multi-turn dialogues with a decoupled user simulation, target modeling, and judging design. It reveals that closed- and open-source models differ significantly on objective intent-tracking but are similar on subjective dimensions, and that reasoning improves objective tracking while persona format strongly affects trajectory spread.

0 favorites 0 likes
← Back to home

Submit Feedback