Tag
BitRun 是一个可在普通笔记本 CPU 上零编译运行 1-bit 三值 LLM 的独立工具，在 Apple M4 Pro 上可达 98–127 t/s、Intel i5 上 40–45 t/s，并修复了微软 bitnet.cpp 代码库中的多个底层 C++ 内核 bug 并提交了上游 PR。
A user released a BitNet trainer that Microsoft never published, along with custom kernels for training and inference, while also highlighting Microsoft's bitnet.cpp inference framework for fast 1-bit LLM inference on CPUs and GPUs.
PrismML announces Bonsai 27B, a 1-bit and ternary quantized version of Qwen3.6 27B that runs on phones and laptops, retaining 90-95% of baseline performance with a 3.9GB footprint, enabling agentic and multimodal on-device AI.
Bonsai 27B is a 1-bit dense large language model that can run locally in a browser using custom WebGPU kernels, enabling efficient on-device inference.
微软官方 BitNet 仓库（bitnet.cpp）的持续更新合集：提供 1-bit/1.58-bit LLM 的高效 CPU/GPU 推理框架，近期新增 BitNet-embedding 0.6B/270M 嵌入模型、I2_S 量化优化内核以及实时多语种 ASR 推理引擎 VibeASR.cpp。