Tag
OCGQuant proposes an outlier-companion grouping method for NVFP4 quantization to reduce activation block errors, enhancing LLM inference efficiency. Experiments on Llama3 and Qwen3 demonstrate its superior performance over existing post-training quantization techniques.
HyGenQ is a post-training quantization framework for hybrid iterative generative models that addresses challenges like excessive outliers and amplified anomalies, enabling 8-bit precision quantization while maintaining generation quality.