tree-topology

Tag

Cards List
#tree-topology

EntMTP: Accelerating LLM Inference with Entropy Guided Multi Token Prediction

arXiv cs.CL · 2026-06-29 Cached

Proposes EntMTP, a training-free scheduler that adapts tree-based attention topologies for speculative decoding based on local entropy estimates, achieving 1.09-1.15x speedup over Hydra and up to 1.36x over Medusa.

0 favorites 0 likes
← Back to home

Submit Feedback