stochastic-decoding

Tag

Cards List
#stochastic-decoding

DBLAST: Dependent Block Drafting for Stochastic Speculative Decoding

arXiv cs.CL · 2026-08-07 Cached

This preprint introduces DBLast, a dependent block drafter for stochastic speculative decoding, using a low-rank latent mixture over token positions and an acceptance-oriented training objective to improve accepted draft length in higher-entropy decoding regimes. Experiments with Qwen3-4B and Qwen3-8B show consistent improvements over independent block sampling.

0 favorites 0 likes
← Back to home

Submit Feedback