knowledge-circuit

Tag

Cards List
#knowledge-circuit

Towards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning

arXiv cs.AI · 2026-07-10 Cached

The paper formalizes the "Knowing-Using Gap" in LLM fine-tuning, where models memorize facts but fail to generalize them. It introduces self-patching intervention and identifies knowledge-circuit misalignment as the root cause, recovering 58-75% of generalization failure with a simple heuristic.

0 favorites 0 likes
← Back to home

Submit Feedback