Fully local little parkour sim
Summary
A developer showcases a fully local parkour simulation built over the weekend using GLM 5.3 Flash running on 2x DGX Sparks with a vLLM TP2 recipe, reporting ~1500 t/s prefill and ~40 t/s decode at 100k context, and praising the model's coding, vision, and 3D understanding. He shares the vLLM NVFP4 configuration repo for others to reproduce the setup.
Similar Articles
GLM 5.3 Flash makes a black hole Minecraft mod running locally on 4x RTX PRO 6000 WS
A user showcased using GLM 5.3 Flash, a local AI model running on 4x RTX PRO 6000 hardware, to iteratively develop a Minecraft black hole rifle mod with the Fabric API, resulting in a functional mod with impressive visuals shared on GitHub.
LFM2.5 230M running in-browser at 1,400 tok/s using custom WebGPU kernels
LFM2.5 230M model achieves 1,400 tokens per second in-browser using custom WebGPU kernels, demonstrating efficient local inference.
Follow-up: GLM-5.2 NVFP4 on four DGX Sparks — the MTP mystery is solved, and it's now ~24 tok/s at 128K context
A bug in vLLM's speculative decoding configuration for GLM-5.2 NVFP4 on four DGX Sparks was fixed, resolving a performance tradeoff and achieving ~24 tok/s at 128K context with MTP4.
GLM 5.3 and GLM 5.3 Flash ran locally on RTX PRO 6000 WS and built a penthouse using BlenderMCP
Author ran GLM 5.3 and GLM 5.3 Flash models locally on RTX PRO 6000 WS hardware to create a 3D penthouse scene in Blender using BlenderMCP, comparing performance and accuracy.
@Ex0byt: Update: the road to GLM-5.2: we're getting there, folks! non-quantized, non-pruned DeepSeek-v4-Flash. 11tok/s on a sing…
Update on running a non-quantized DeepSeek-v4-Flash model at 11 tok/s on a single DGX Spark using sglang inference and a custom mega-kernel, progressing towards GLM-5.2.