Tag
作者做了一个实验,让指令微调的 LLM 反向生成"用户轮次"(user_start token 之后的文本),测试约 30 个模型后发现用 chat template 反转技巧比角色扮演 system prompt 更能模仿真人,其中 Mistral Small 3 24B 表现最佳。结果和代码已开源在 selfgpt 网站与 GitHub 仓库。
A Hugging Face repo publishes improved Jinja chat templates (including a 'Sharp' terse option) for Qwen3.8-Flash-Next on llama.cpp, adding per-message thinking/terseness tags and fixes for tool-call rendering and empty-think poisoning.
The study reveals that chat templates control whether language models adopt a disclaimer voice (e.g., 'I'm just an AI') or an experiential voice (e.g., 'I feel'), and identifies an activation direction that can steer this behavior, impacting AI safety research.
This article describes a drop-in chat template fix for Qwen AI models that improves accuracy, reduces token usage, and speeds up responses for knowledge work and coding tasks.
Google updated Gemma 4's chat templates with major fixes to tool calling, reduced laziness, enabled Flash Attention 4 on Hopper GPUs, and released an interactive vision guide. The updates are available on Hugging Face.
This article explores the GGUF file format used by llama.cpp for language models, highlighting its single-file convenience and the role of embedded chat templates and special tokens. It also compares different Jinja implementations and discusses what is still missing from the format.