PSA on Laguna S-2.1 - Use the updated chat template and GGUF
Summary
Laguna S-2.1 model has been updated with a fix for yarn_attn_factor (corrected to 1.0) and an improved chat template that fixes broken thinking, preserves thinking, and enables tool calling. Users are advised to use the updated GGUF from the official repo.
Similar Articles
Laguna S 2.1 Thinking mode
Reports a bug in Laguna S 2.1 where reasoning phase fails if preserve_thinking is disabled, and suggests comparing with Qwen 27B chat template to fix the issue.
PSA: Gemma 4 12B is NOT completely broken for coding and tool calling, you need a special chat template
Gemma 4 12B has a known issue with tool calling and coding, but using a custom chat template in llama.cpp resolves the bugs. Users should compile llama.cpp from source and apply the fix before evaluating the model's coding ability.
PSA: unsloth/GLM-5.2-GGUF is uploading
unsloth has uploaded a GGUF version of GLM-5.2 to Hugging Face, providing ready-to-use model files for various inference engines like llama.cpp, vLLM, and SGLang.
poolside/Laguna-S-2.1-GGUF
Poolside releases GGUF quantizations of the Laguna S 2.1 AI model, including a DFlash speculative decoding draft model, enabling efficient local inference with llama.cpp.
Laguna S 2.1 looping fix incoming
Poolside released Laguna S 2.1, their most capable model for long-horizon tasks, along with multiple quantized variants (FP8, NVFP4, INT4, DFlash, GGUF) on Hugging Face.