linear-readouts

Tag

Cards List
#linear-readouts

Same Evidence, Different Target: Decoding How Diagnostic Evidence Bears on Causal Questions from Language-Model States

arXiv cs.CL · 2d ago Cached

This paper investigates whether language models can correctly judge how diagnostic evidence supports or challenges different causal claims, introducing paired prompts that vary only the causal target. Linear readouts from the penultimate transformer hidden state on models like Qwen2.5-7B-Instruct show moderate balanced accuracy (0.654-0.659) and recover 18–21 out of 49 pairs, indicating some linear decodability of causal relevance.

0 favorites 0 likes
← Back to home

Submit Feedback