training-instability

Tag

Cards List
#training-instability

Mechanism-Driven Monitors for Preemptive Detection of LLM Training Instability

arXiv cs.CL · 2026-06-29 Cached

Proposes mechanism-driven monitors for preemptive detection of LLM training instability by deriving internal signals from low-precision flash attention and MoE routers, enabling detection thousands of steps before loss divergence.

0 favorites 0 likes
← Back to home

Submit Feedback