channel-scaling

Tag

Cards List
#channel-scaling

Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization

arXiv cs.LG · 2026-06-10 Cached

This paper proposes trainable smooth-rotation transforms with quantile-robust scaling and gradient-based optimization to improve post-training quantization of LLMs, achieving significant error reduction on LLaMA-3.2-1B under W4A4 quantization.

0 favorites 0 likes
← Back to home

Submit Feedback