prompt-design

Tag

Cards List
#prompt-design

Prompt Design at Scale: How Format, Instruction Count, and Context Length Shape Instruction Adherence and Hallucination in Large Language Models

arXiv cs.CL · 2026-07-22 Cached

This paper investigates how format, instruction count, and context length affect instruction adherence and hallucination in LLMs through controlled experiments on a synthetic corpus, finding that instruction-following collapses beyond 80 rules regardless of format, and recall degrades sharply after 64-128k tokens with format-dependent effects. It releases the VeyraBench harness for reproduction.

0 favorites 0 likes
← Back to home

Submit Feedback