mha

Tag

Cards List
#mha

Beyond KV Reconstruction: Functional Reconstruction for MLA Draft Models in Speculative Decoding

arXiv cs.LG · 3d ago Cached

This paper proposes functional reconstruction for converting MHA/GQA checkpoints into MLA draft models for speculative decoding, directly optimizing attention modules to preserve token acceptance. It reports consistent improvements across 192 configurations involving Llama/Qwen models and multiple conversion methods.

0 favorites 0 likes
← Back to home

Submit Feedback