Giving GLM-5.2 a spin locally on CPU only! (poor man's rig for big models)
Summary
A user runs GLM-5.2 locally on CPU only, demonstrating how to run a large model on a modest setup.
Similar Articles
Colibri Hands-on: Running GLM 5.2 (744B) Locally without GPU
Colibri enables running the 744B-parameter GLM 5.2 model locally on CPU, making large-scale AI accessible without GPU hardware.
Cheapest way to run GLM 5.x locally that's not a unified memory system?
A discussion on the cheapest local hardware setups for running GLM 5.x and similarly sized models at 4-bit quantization, including CPU-only and multi-GPU options, with a user sharing their experience running Minimax 2.7 and Qwen 3.6 on a 5900X + 128GB DDR4 + 7900XT setup.
Running GLM5.2 on budget hardware < $2500.
A guide showing how to build a system under $2500 using used server components to run GLM5.2 and other large AI models locally, with trade-offs in speed.
Show HN: Getting GLM 5.2 running on my slow computer
Colibrì is a pure C inference engine that runs the 744B GLM-5.2 MoE model on consumer hardware with ~25GB RAM by streaming experts from disk, achieving ~2.2-2.8 tokens/second with speculative decoding.
GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey
A report on running the GLM5.2 language model across 5 AMD Radeon Pro 6000 GPUs and an NVIDIA RTX 5090, detailing the high cost and technical challenges.