softmax-thresholding

Tag

Cards List
#softmax-thresholding

@jiayiy: BLASST just won Best Paper at #MLSys26! In this paper, we introduce a simple, training-free dynamic sparse attention me…

X AI KOLs Following · 2026-05-18 Cached

BLASST, a training-free dynamic sparse attention mechanism using a single scalar threshold on online softmax statistics, won Best Paper at MLSys26. It achieves speedups of 1.52x for prefill and 1.48x for decode with over 70% sparsity while preserving accuracy.

0 favorites 0 likes
← Back to home

Submit Feedback