activation-quantization

Tag

Cards List
#activation-quantization

InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization

arXiv cs.LG ↗ · 2026-05-27 Cached

InfoQuant introduces a train-free method, Peak Suppression Orthogonal Transformation (PSOT), to reshape activation distributions for low-bit LLM quantization, preserving 97% floating-point accuracy under W4A4KV4 and outperforming prior PTQ methods.

0 favorites 0 likes
← Back to home

Submit Feedback