block-drafting

Tag

Cards List
#block-drafting

Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models

arXiv cs.AI ↗ · 2026-09-02 Cached

The paper introduces GLANCE, a one-pass block drafting method for lossless speculative decoding in vision-language models, achieving up to 2.93x faster generation without changing output.

0 favorites 0 likes
#block-drafting

DBLAST: Dependent Block Drafting for Stochastic Speculative Decoding

arXiv cs.CL ↗ · 2026-08-07 Cached

This preprint introduces DBLast, a dependent block drafter for stochastic speculative decoding, using a low-rank latent mixture over token positions and an acceptance-oriented training objective to improve accepted draft length in higher-entropy decoding regimes. Experiments with Qwen3-4B and Qwen3-8B show consistent improvements over independent block sampling.

0 favorites 0 likes
← Back to home

Submit Feedback