Was BitNet a dead end? What happened to ternary LLMs?
Summary
The article questions why ternary language models like BitNet have not scaled beyond 2B parameters, given their initial promise, and discusses the apparent lack of progress from open-weight AI labs.
Similar Articles
Bitnet.cpp: Efficient Edge Inference for Ternary LLMs
Bitnet.cpp presents a mixed-precision matrix multiplication library for efficient edge inference of ternary LLMs like BitNet b1.58, achieving up to 6.25x speedup over full-precision baselines. The system is open-sourced on GitHub.
1-bit / 2-bit / Ternary / Bitnet Models - Updates & Tracking
This article tracks updates on various low-bit AI models, including Bonsai, BitCPM, and others, with performance improvements and compatibility updates for backends like llama.cpp.
BitNet Text Embeddings
This paper introduces BitEmbed, an extreme low-bit framework for LLM-based text embeddings that converts pretrained LLM backbones into BitNet-style encoders with ternary weights and quantized activations. It achieves comparable performance to full-precision models while significantly reducing encoding and storage costs.
Is ternary (1.58-bit) LLMs making a come back?
Recent ternary 1.58-bit LLM releases from small labs demonstrate speed and medical specialization but struggle with long-horizon tasks, with optimism for future models to compete with larger architectures like Qwen.
Ternary Bonsai: Top Intelligence at 1.58 Bits
A highly efficient AI model architecture using ternary weights (-1, 0, 1) that achieves competitive performance while requiring only 1.58 bits per parameter, enabling deployment on extremely constrained devices.