llm-conformity

Tag

Cards List
#llm-conformity

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity

arXiv cs.CL · 2026-08-06 Cached

This paper introduces an experimental protocol to measure open-ended LLM conformity, showing that wrong peer input degrades revision quality and that evaluators are not neutral when shown peer context, highlighting the need for anchor calibration.

0 favorites 0 likes
#llm-conformity

Most LLM Conformity Needs No Speaker: Measuring the Speaker-Free Floor in Peer-Pressure Benchmarks

arXiv cs.CL · 2026-07-08 Cached

This paper reveals a confound in LLM conformity benchmarks: standard prompts mix a speaker cue with repeated wrong answers. By introducing a 'no-source' condition that removes the explicit speaker, the authors show that most apparent conformity persists even without a speaker, challenging previous interpretations of social influence.

0 favorites 0 likes
← Back to home

Submit Feedback