Tag
This paper introduces disaggregated quantization, a method that tailors quantization approaches for LLM prefill and decode phases to enhance inference efficiency and accuracy.