layer-ordering

Tag

Cards List
#layer-ordering

Library of Layers (LoL): Adaptively Ordering Transformer Layers at Runtime

Hugging Face Daily Papers ↗ · 6d ago Cached

The paper introduces Library of Layers (LoL), a transformer architecture that dynamically reorders its layers at inference time, unifying parameter reuse and sparsity tradeoffs across dense, depth-recurrent, and MoE baselines while enabling interpretable routing across reasoning, multilingual, and safety tasks.

0 favorites 0 likes
← Back to home

Submit Feedback