variable-width

Tag

Cards List
#variable-width

Variable-Width Transformers

Hugging Face Daily Papers ↗ · 2026-06-16 Cached

Proposes a nonuniform width allocation transformer (hourglass shape) that outperforms uniform baselines in language modeling, reducing FLOPs and KV cache size.

0 favorites 0 likes
← Back to home

Submit Feedback