synthetic-errors

Tag

Cards List
#synthetic-errors

Pigeonholing: Bad prompts hurt models to collapse and make mistakes

arXiv cs.CL · 2026-06-24 Cached

This paper introduces 'pigeonholing,' a phenomenon where bad prompts cause LLMs to collapse and repeat errors, leading to a 38-40% performance drop. Experiments across 10 tasks and 10 models show worsening with more conversation turns, and propose RLVR with synthetic errors as a mitigation.

0 favorites 0 likes
← Back to home

Submit Feedback