moe-routing

GLM-5.3, an AI model with unchanged architecture from GLM-5.2, has achieved significant improvements through training and is now visualizable in HF Viewer, showcasing complex features like sparse attention and MoE routing.

NVIDIA and Unsloth have published a technical guide detailing three low-level optimizations that can accelerate LLM fine-tuning by up to 25%, including packed-sequence caching, double-buffered checkpointing, and optimized MoE routing. The guide provides deep systems-level explanations and benchmarks aimed at ML engineers and developers.