hidden-state-trajectories

Tag

Cards List
#hidden-state-trajectories

Semantic Step Prediction: Multi-Step Latent Forecasting in LLM Reasoning Trajectories via Step Sampling

Reddit r/LocalLLaMA · 2026-05-31 Cached

This paper introduces Semantic Step Prediction, which applies geometric regularization at reasoning step boundaries rather than random token positions, achieving 168× better multi-step latent forecasting on ProcessBench compared to frozen baselines.

0 favorites 0 likes
#hidden-state-trajectories

Before the Last Token: Diagnosing Final-Token Safety Probe Failures

arXiv cs.LG · 2026-05-14 Cached

This paper investigates failures of final-token safety probes on jailbreak prompts, finding that harmful content can be distributed across earlier tokens and missed by the final readout. It proposes a PCA-HMM trajectory model as a diagnostic tool that recovers many misses without the false positives of naive token pooling.

0 favorites 0 likes
← Back to home

Submit Feedback