adaptive-exit

Tag

Cards List
#adaptive-exit

Looped State-Space Language Models with Adaptive Exit-State Selection

arXiv cs.AI · 5d ago Cached

This paper explores looped (recurrent) state-space language models using Mamba and hybrid Mamba-Transformer backbones, showing they outperform non-looped baselines on reasoning tasks and remain competitive under iso-parameter and iso-FLOPs pretraining, with adaptive exit-state selection improving intermediate-depth performance.

0 favorites 0 likes
← Back to home

Submit Feedback