reasoning-errors

Tag

Cards List
#reasoning-errors

Reasoning Errors Have a Region and a Direction in the Residual-Stream Trajectory of LLMs

arXiv cs.LG ↗ · 2026-08-07 Cached

This paper proposes a three-stream detector that combines residual-stream motion with coarse regions and fine directions to better identify reasoning errors in LLMs, improving selection accuracy by up to 12% over state-of-the-art displacement-only methods.

0 favorites 0 likes
#reasoning-errors

Manifold-Guided Attention Steering

arXiv cs.LG ↗ · 2026-05-22 Cached

Proposes Manifold-Guided Attention Steering (MAGS), a trajectory-aware inference-time intervention that corrects reasoning errors in LLMs by projecting attention outputs back to a learned correctness manifold when deviation exceeds a threshold, outperforming static steering methods across math, code, and molecular benchmarks.

0 favorites 0 likes
← Back to home

Submit Feedback