efficient-caching

Tag

Cards List
#efficient-caching

@alec_helbling: Diffusion LMs generate multiple tokens in parallel. However, iterative unmasking repeatedly updates token states, limit…

X AI KOLs Following ↗ · 2026-09-11 Cached

The post describes how diffusion language models face KV-cache reuse limitations due to iterative unmasking, and introduces Block Diffusion as a solution that decodes blocks left-to-right for efficient caching while generating in parallel.

0 favorites 0 likes
← Back to home

Submit Feedback