mid-to-long-context

Tag

Cards List
#mid-to-long-context

BudgetDraft: Acceptance-Aware Multi-View Training for Sparse-KV Speculative Decoding

arXiv cs.LG · 2026-06-02 Cached

BudgetDraft proposes a multi-view training method for speculative decoding that aligns a sparse-KV drafter with a full-KV verifier, achieving significant speedups for mid-to-long context inference.

0 favorites 0 likes
← Back to home

Submit Feedback