hybrid-llm

Tag

Cards List
#hybrid-llm

Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

Hugging Face Daily Papers ↗ · 2026-09-03 Cached

This paper explains why fully quantizing the recurrent Gated DeltaNet layers in hybrid LLMs to 4-bit NVFP4 preserves accuracy across long-context benchmarks, detailing mechanisms like outlier localization and robust delta-rule dynamics.

0 favorites 0 likes
← Back to home

Submit Feedback