Colibri Hands-on: Running GLM 5.2 (744B) Locally without GPU
Summary
Colibri enables running the 744B-parameter GLM 5.2 model locally on CPU, making large-scale AI accessible without GPU hardware.
Similar Articles
@ErickSky: Forget about vLLM, llama.cpp, and expensive GPUs. [colibri] This runs GLM-5.2 (744B MoE) on ~25 GB of RAM with pure C a…
colibri is a pure C inference tool that runs the GLM-5.2 744B MoE model on ~25 GB RAM by streaming experts from disk, eliminating the need for expensive GPUs.
Giving GLM-5.2 a spin locally on CPU only! (poor man's rig for big models)
A user runs GLM-5.2 locally on CPU only, demonstrating how to run a large model on a modest setup.
Show HN: Getting GLM 5.2 running on my slow computer
Colibrì is a pure C inference engine that runs the 744B GLM-5.2 MoE model on consumer hardware with ~25GB RAM by streaming experts from disk, achieving ~2.2-2.8 tokens/second with speculative decoding.
@GPTWare: Uhhhh WTF is this???
Colibri runs the 744B parameter GLM-5.2 MoE model on a laptop with 25GB RAM by activating only ~40B parameters per token and streaming experts from disk, all in a single 2,400-line C file with no GPU required.
@danveloper: Now everyone does it
Zane Chen demonstrates Colibri, which runs GLM-5.2 (744B MoE) on a laptop with 25GB RAM using pure C and CPU-only inference, by streaming experts from disk.