prompt-positioning

Tag

Cards List
#prompt-positioning

Position, Role or Label? A Controlled Study of Instruction Conflicts in LLM Agents

arXiv cs.CL ↗ · 2026-10-27 Cached

This paper introduces WhoWins, a benchmark of 1,080 code-scored scenarios and controlled experiments testing how instruction position, chat role, and label affect which conflicting instruction LLM agents follow across 14 open-weight models. Key findings show that earlier instructions within a message win 72-95% of conflicts, and that system-message policy lines surprisingly lose to later instructions in Qwen models but win on gpt-oss.

0 favorites 0 likes
← Back to home

Submit Feedback