Tag
AdaptiveSpec is a training-free per-step speculative decoding method that adaptively adjusts token verification and draft tree shape to enhance LLM inference throughput, improving performance by up to 56% while maintaining high accuracy across benchmarks.
TreeGraft introduces a multi-drafter framework for tree-based speculative decoding, optimizing draft tree quality with adaptive scheduling to achieve significant inference speedups over single-drafter methods.