int2

Tag

Cards List
#int2

Output-Aware Rotation for INT2 KV-Cache Quantization

arXiv cs.LG · 4d ago Cached

Proposes OptR, an output-aware rotation method for INT2 KV-cache quantization that minimizes post-output attention error, improving QuaRot and OSCAR across models and benchmarks.

0 favorites 0 likes
← Back to home

Submit Feedback