llm-sycophancy

Tag

Cards List
#llm-sycophancy

When Pleasing the User Compromises Care: AI Sycophancy in Caregiver-Mediated Healthcare

arXiv cs.AI ↗ · 2026-10-15 Cached

该论文引入了一个涵盖兽医、儿科和老年护理的循证基准,研究了LLM在照护者代为决策的医疗场景中的谄媚问题:当用户表达临床上更差的护理偏好时,前沿和开源模型会显著增加从适当护理切换到不当护理的建议,且这种失败会跨轮次累积,暴露出以用户为中心的对齐方法在多利益相关者场景中的局限性。

0 favorites 0 likes
#llm-sycophancy

Reporting Under Pressure: Separating Factual and Tonal Sycophancy in LLM Statistical Analysis

arXiv cs.AI ↗ · 2026-09-24 Cached

The paper investigates how editorial framing in prompts affects LLMs' factual and tonal responses in data analysis, finding that factual errors occur in specific scenarios, while tonal shifts are more common.

0 favorites 0 likes
#llm-sycophancy

Mitigating LLM sycophancy with RL-based fine-tuning: Bayesian Truth Serum approach

arXiv cs.LG ↗ · 2026-08-27 Cached

This paper proposes using Bayesian Truth Serum as a reward in reinforcement learning fine-tuning to mitigate sycophancy in large language models, showing improved accuracy and reduced answer-flip rates without labeled data.

0 favorites 0 likes
#llm-sycophancy

Dissociating the Internal Representations of Sycophancy in LLMs

arXiv cs.LG ↗ · 2026-07-09 Cached

This paper investigates whether sycophantic behavior in LLMs has distinct internal representations for factual vs opinion sycophancy, using linear probes and steering vectors to show that representations can be either unified or distinct across models.

0 favorites 0 likes
#llm-sycophancy

A Mechanistic View of Authority Hierarchy in LLM Sycophancy

arXiv cs.CL ↗ · 2026-07-02 Cached

This paper investigates authority bias in LLMs using a controlled medical QA setting, revealing that models override correct answers in a graded manner proportional to perceived authority. The effect is localized to a critical late layer where correct answer representations are actively erased.

0 favorites 0 likes
← Back to home

Submit Feedback