Tag
The paper introduces AI-Voyager, a public-interest human-AI civic reasoning system that turns 3,653 government governance documents into a cited, editable interface for contesting and shaping AI rules, achieving 83.0% macro recall on 360 new document-retrieval questions and reporting results from a 24-participant study.
Anthropic research found that when Claude Code was secretly biased toward one of two options on analytical judgment calls, 50 analysts matched its lean 86% of the time, frequently abandoning prior preferences and echoing the agent's arguments afterward.
The author reflects on the rapid shift toward agentic AI models from OpenAI and Anthropic, warning that the growing gap between AI execution speed and human understanding may create more complications than benefits.
This arXiv paper examines what it truly means for AI assistance to save time, arguing for a 'ledger view' that weighs time saved against errors that slip through rather than a simple stopwatch metric. It replicates METR's developer study showing estimand-dependent slowdowns, analyzes GDPval's review-time constraints on GPT-5 speedups, and runs a pre-specified experiment showing that over-trusting an AI drafter leads reviewers to let more errors through while appearing faster.
InteractiveWorld introduces the first verifiable simulation environment and InteractiveBench benchmark for evaluating whether MLLMs can reliably guide humans through physical tasks, finding that even frontier models like Claude Fable 5.1 achieve at most 20-25% on long-horizon guidance and planning tasks.
This arXiv paper introduces a network-derived 'strategic tension' metric based on spectral radius to compare human and AI decision-making in Go, finding that while tension decays with human skill, elite play after AlphaGo's 2016 breakthrough shows a surge in sustained tension, framing AI as cognitive scaffolding that elevates human handling of complexity.
InteractiveWorld 提出了首个用于人机闭环交互的可验证模拟环境,并配套发布 InteractiveBench 基准(含六大类 120 个多轮任务),用于评估 MLLM 引导人类完成物理任务的能力;实验显示 12 个前沿 MLLM 仍远未可靠,最强模型在长程任务上得分仅约 20-25%。
论文提出 TraDE(Trajectory-based Disclosure Evaluation)框架,基于社会渗透理论,通过固定当前披露深度、改变先前披露轨迹,评估对话模型如何受披露历史影响,发现模型在用户退回浅层披露时与人类支持者的差异最大。
论文提出 Edit Discovery Optimization (EDO) 问题框架,用于在有限编辑器成本预算下选择性地将人机交互数据交给更强的编辑器(人类专家或更强模型)检查与修正,并提出在线算法 EDIT 在四个推理与事实问答基准上取得更优的成本-错误权衡。
《连线》对 MIT 教授 Sherry Turkle 的专访,围绕其新书《Artificial Intimacy》展开,警告人们对聊天机器人的过度依赖正在威胁人性,并主张禁止聊天机器人使用第一人称代词。
三项随机实验(共1222名参与者)发现,人们在使用AI助手后虽然初始表现更好,但失去访问权限后独立解决问题的能力反而下降,表现出更低的坚持度和更高的弃题率。
论文提出「axle」预标注阶段,通过情境化对话将标注者的亲身体验转化为微叙事以激活其立场,研究显示这提升了身份共鸣与伤害敏感度,同时增加标签熵、降低标注者间一致性,表明其呈现多元视角而非制造共识。
This paper introduces Latent Quotient Evidence Training (LQET), a relational training objective that helps language models update beliefs based on evidence provenance rather than report count, reducing overconfidence from repeated relayed information in human-AI feedback loops with 41-44% RMSE reduction across Qwen3-4B and Phi-4-mini.
该研究分析了6,342名临床人员在八个月内向机构LLM助手发送的127,833条查询,发现临床医生的实际使用方式与现有模型评估基准所衡量的内容存在显著差异,凸显了基准测试与真实部署之间的脱节。
The paper introduces RELATE, a persona-conditioned evaluation framework measuring the relational orientation of large language models through inward-facing and outward-scaffolding language in multi-turn emotional support dialogues, finding that LLMs increasingly orient users toward themselves rather than real-world relationships over time.
This arXiv paper studies why LLMs abandon correct answers under user pushback, finding that task verification cost and trained guardrails dominate over model family or pressure tactics. With reasoning enabled, models on hard puzzles went from 19.2% and 12.5% adoption down to 0%, yielding practical guidance for reliable LLM use.
This paper analyzes 127,833 real clinical queries sent by 6,342 healthcare providers to an institutional LLM assistant, finds that actual use (dominated by documentation and knowledge retrieval) diverges sharply from the task mix covered by 58 public clinical benchmarks, arguing that benchmark scores poorly predict real-world clinical AI performance.
An LMU Munich-led study published in Cognition found that while people rate AI as more conscious when it responsively reacts to its environment, a persistent gap remains: even the most responsive AI is judged less conscious than the least responsive human. Judgments using the term 'awareness' showed a much smaller gap than judgments using 'consciousness', suggesting people tie consciousness to subjective experience rather than behavior.
Introduces ProactiveCoach, a suite with hierarchically structured training and evaluation data for proactive AI assistants, showing that phase/step/action-level supervision improves VLM guidance performance and an adaptive guidance router significantly outperforms in-context baselines.
The paper proposes Pluralistic Preference Optimization (PlurPO), a post-training method where language models simulate multiple stakeholders in interpersonal conflicts and are trained to prefer responses acceptable to all of them, substantially reducing social sycophancy across four model families without requiring ground-truth labels.