causal-parallel-drafting

Tag

Cards List
#causal-parallel-drafting

JetFlow: Breaking the Scaling Ceiling of Speculative Decoding with Parallel Tree Drafting

arXiv cs.CL ↗ · 2026-06-18 Cached

JetFlow is a speculative decoding framework that breaks the scaling ceiling by combining one-forward drafting efficiency with branch-wise causal conditioning, achieving up to 9.64x speedup on math benchmarks and outperforming prior methods on dense and MoE Qwen3 models.

0 favorites 0 likes
← Back to home

Submit Feedback