block-parallel-diffusion

Tag

Cards List
#block-parallel-diffusion

AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding

arXiv cs.CL · 5d ago Cached

AngelSpec introduces a unified training and inference framework for speculative decoding that jointly optimizes autoregressive multi-token prediction and block-parallel diffusion drafters to handle heterogeneous real-world workloads. Experiments on the Hy3 model series show up to 2.4x speedup over autoregressive decoding and 11.8% higher throughput than DFlash.

0 favorites 0 likes
← Back to home

Submit Feedback