sparse-matrix

#sparse-matrix

SparseDecoding: Decoding-Aware Pruning for Accurate and Efficient LLM Inference

Hugging Face Daily Papers ↗ · 2026-10-08 Cached

提出了SparseDecoding，一种面向解码阶段的训练无关剪枝框架，通过在自回归生成时收集校准数据对齐Hessian分布，并开发优化的N:M稀疏矩阵向量核，在A100上实现最高1.48倍端到端解码加速。

0 favorites 0 likes

#sparse-matrix

A Feature-Major Codebook for Memory-Efficient Sparse-Binary Self-Organizing Maps: Scaling a MEDLINE Atlas to 1.05 Million Neurons on a Single Consumer GPU

arXiv cs.LG ↗ · 2026-08-26 Cached

This paper presents a feature-major codebook layout for memory-efficient sparse-binary self-organizing maps, enabling the training of large-scale maps up to 1.05 million neurons on a single GPU with significant speed improvements for MEDLINE data.

0 favorites 0 likes

sparse-matrix

SparseDecoding: Decoding-Aware Pruning for Accurate and Efficient LLM Inference

A Feature-Major Codebook for Memory-Efficient Sparse-Binary Self-Organizing Maps: Scaling a MEDLINE Atlas to 1.05 Million Neurons on a Single Consumer GPU

Submit Feedback