ternary-decomposition

#ternary-decomposition

i tried ternary decomposition instead of quantization. it works as good at q4km but takes slightly more vram. while being completly ternary. and completly PTQ (no QAT)

Reddit r/LocalLLaMA ↗ · 2026-07-16

The author claims that ternary decomposition performs as well as Q4_K_M quantization while using slightly more VRAM, and is fully ternary and PTQ without QAT.

0 favorites 0 likes

#ternary-decomposition

ExTernD: Expanded-Rank Ternary Decomposition Ternary LLM PTQ with Accuracy Approaching Any Quantization Level

arXiv cs.LG ↗ · 2026-07-16 Cached

ExTernD introduces an expanded-rank ternary decomposition for post-training LLM quantization, enabling accuracy approaching bf16 by using a factored representation with free inner rank. It matches Q4_K accuracy at 5.2-5.5 effective bits per weight on models like Gemma-4 and Qwen3.5.

0 favorites 0 likes

ternary-decomposition

i tried ternary decomposition instead of quantization. it works as good at q4km but takes slightly more vram. while being completly ternary. and completly PTQ (no QAT)

ExTernD: Expanded-Rank Ternary Decomposition Ternary LLM PTQ with Accuracy Approaching Any Quantization Level

Submit Feedback