1-bit-llm

Tag

Cards List
#1-bit-llm

@QuixiAI: @MicrosoftAI never published a BitNet trainer. I fixed that bug. https://github.com/QuixiAI/bitnet trained my own BitNe…

X AI KOLs Following · yesterday Cached

A user released a BitNet trainer that Microsoft never published, along with custom kernels for training and inference, while also highlighting Microsoft's bitnet.cpp inference framework for fast 1-bit LLM inference on CPUs and GPUs.

0 favorites 0 likes
#1-bit-llm

Bonsai 27B (1-bit LLM): The First 27B-Class Model to Run on a Phone

Hacker News Top · yesterday Cached

PrismML announces Bonsai 27B, a 1-bit and ternary quantized version of Qwen3.6 27B that runs on phones and laptops, retaining 90-95% of baseline performance with a 3.9GB footprint, enabling agentic and multimodal on-device AI.

0 favorites 0 likes
#1-bit-llm

Bonsai 27B: 1-bit dense LLM running locally in your browser using custom WebGPU kernels

Reddit r/LocalLLaMA · yesterday

Bonsai 27B is a 1-bit dense large language model that can run locally in a browser using custom WebGPU kernels, enabling efficient on-device inference.

0 favorites 0 likes
← Back to home

Submit Feedback