static-quantization

Tag

Cards List
#static-quantization

Quant.npu: Enabling Efficient Mobile NPU Inference for on-device LLMs via Fully Static Quantization

arXiv cs.LG · 2026-05-21 Cached

Quant.npu introduces a fully static quantization framework for mobile NPUs, using learnable parameters and rotation matrices to enable efficient low-bit LLM inference without runtime re-computation, achieving up to 15.1% latency reduction.

0 favorites 0 likes
← Back to home

Submit Feedback