attention-distillation

标签

Cards List
#attention-distillation

Learning to Predict Middle-Layer Attention in MLLMs for Visual Token Prunin

arXiv cs.AI · 昨天 缓存

This paper introduces a method to predict middle-layer attention in multimodal LLMs to prune visual tokens efficiently, using question-contrastive teacher selection and cross-modal attention distillation.

0 人收藏 0 人点赞
← 返回首页

提交意见反馈