speculative-drafting

Halogen version 0.12.0 fixes performance degradation at high context depths, showing improved decode and prefill speeds for Qwen3.8-Flash-Next at 1 million tokens of context on AMD Ryzen AI Max+ hardware.

This paper introduces speculative draft trees to accelerate diffusion model sampling by enriching candidate drafts and using greedy rejection sampling, achieving up to 8.3% speedup over baseline methods.