post-hoc-intervention

Tag

Cards List
#post-hoc-intervention

Correcting Suppressed Log-Probabilities in Language Models with Post-Transformer Adapters

arXiv cs.CL · 2026-04-20 Cached

This paper demonstrates that a small post-transformer adapter (786K parameters) can correct suppressed log-probabilities in alignment-tuned language models, particularly on politically sensitive topics. The adapter shows 31-39% generalization to held-out facts across Qwen3 models while maintaining coherent generation when applied at the final prediction position.

0 favorites 0 likes
← Back to home

Submit Feedback