Reducing the model parameter size?
Summary
Discusses methods or research on reducing the size of model parameters, likely focusing on techniques like pruning or quantization to improve efficiency.
Similar Articles
Optimizing Transformer model size & inference beyond FP16 + ONNX (pruning/graph opt didn’t help much) [P]
Author shares experience hitting diminishing returns with FP16 + ONNX + pruning on 162 MB transformer, seeks advice on next best steps among quantization, distillation, low-rank factorization, or hardware-specific tricks.
SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training
This paper explores structured pruning and knowledge distillation techniques for compressing large Mixture-of-Experts (MoE) models during pre-training. It demonstrates that progressive pruning and combined distillation strategies, such as multi-token prediction distillation, improve downstream performance, exemplified by compressing Qwen3-Next-80A3B to a more efficient 23A2B model.
Parameter Golf: What Really Works?
A paper analyzing the Parameter Golf open challenge for training language models under strict size and time constraints, finding that individual techniques rarely improve BPB by more than 1% but collectively achieved a 13.6% reduction.
[Paper] Statistically-Lossless Quantization of Large Language Models
This paper presents a statistically-lossless quantization method for large language models, aiming to reduce model size without information loss.
Rethinking Small VLM Quantization: From Component-Wise Analysis to Hardware-Aware Edge Deployment
This paper systematically evaluates component-wise quantization of small vision-language models on Jetson edge devices, finding that model architecture (MoE vs dense) significantly affects quantization sensitivity and that quantization errors are largely additive except along modality-alignment paths.