bdq

Tag

Cards List
#bdq

Theory-optimal Quantization Based on Flatness

arXiv cs.LG ↗ · 2026-05-20 Cached

Introduces Flatness metric and Bidirectional Diagonal Quantization (BDQ) for post-training quantization of large language models, achieving near-lossless 4-bit weight and activation quantization and substantial improvements at extreme low-bit settings.

0 favorites 0 likes
← Back to home

Submit Feedback