question-order-effects

Tag

Cards List
#question-order-effects

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat

arXiv cs.CL · 6d ago Cached

This paper develops the QQ equality from cognitive science into an audit criterion for LLMs, characterizes theoretical mechanism classes, and empirically tests on an open-weight instruction-tuned model, finding that saturation (near-deterministic responses) prevents distribution-level audits.

0 favorites 0 likes
← Back to home

Submit Feedback