activation-patching

Tag

Cards List
#activation-patching

Interaction Locality in Hierarchical Recursive Reasoning

arXiv cs.AI ↗ · 2026-05-22 Cached

Proposes interaction locality, a task-geometry-aware framework for measuring whether information flow in spatial reasoning models stays within local cells or crosses into global structure, and applies it to HRM, TRM, and MTU3D models on grid benchmarks and embodied 3D grounding.

0 favorites 0 likes
#activation-patching

From Correlation to Cause: A Five-Stage Methodology for Feature Analysis in Transformer Language Models

arXiv cs.CL ↗ · 2026-05-22 Cached

This paper proposes a five-stage methodology for causal feature analysis in transformer language models, demonstrated on GPT-2 small for the IOI task. It finds that features are specifically causal but not necessary, and exposes a gap between detection and causal robustness.

0 favorites 0 likes
#activation-patching

Negative Before Positive: Asymmetric Valence Processing in Large Language Models

arXiv cs.CL ↗ · 2026-05-08 Cached

This paper investigates how large language models process emotional valence through mechanistic interpretability. Using activation patching and steering on three open-source LLMs, the authors find that negative valence is localized to early layers while positive valence peaks in mid-to-late layers, and they validate this through topic-controlled flip tests.

0 favorites 0 likes
#activation-patching

Hallucination as Trajectory Commitment: Causal Evidence for Asymmetric Attractor Dynamics in Transformer Generation

arXiv cs.CL ↗ · 2026-04-20 Cached

This paper presents causal evidence that hallucination in autoregressive language models results from early trajectory commitment governed by asymmetric attractor dynamics, using same-prompt bifurcation and activation patching experiments on Qwen2.5-1.5B to show that hallucinated trajectories diverge at the first token and exhibit strong causal asymmetry across model layers.

0 favorites 0 likes
← Previous
← Back to home

Submit Feedback