chat-templates

Tag

Cards List
#chat-templates

I tried reversing chat templates to see which models are the best at generating user turns

Reddit r/LocalLLaMA ↗ · 2026-10-22

作者做了一个实验,让指令微调的 LLM 反向生成"用户轮次"(user_start token 之后的文本),测试约 30 个模型后发现用 chat template 反转技巧比角色扮演 system prompt 更能模仿真人,其中 Mistral Small 3 24B 表现最佳。结果和代码已开源在 selfgpt 网站与 GitHub 仓库。

0 favorites 0 likes
#chat-templates

Improved Qwen3.8-Flash Chat Template (w/ Sharp Template terse option)

Reddit r/LocalLLaMA ↗ · 2026-10-16 Cached

A Hugging Face repo publishes improved Jinja chat templates (including a 'Sharp' terse option) for Qwen3.8-Flash-Next on llama.cpp, adding per-message thinking/terseness tags and fixes for tool-call rendering and empty-think poisoning.

0 favorites 0 likes
#chat-templates

"As a Language Model...": Chat Template Switches LLM Self-Referential Voice and Activation Steering Reproduces It

arXiv cs.LG ↗ · 2026-09-23 Cached

The study reveals that chat templates control whether language models adopt a disclaimer voice (e.g., 'I'm just an AI') or an experiential voice (e.g., 'I feel'), and identifies an activation direction that can steer this behavior, impacting AI safety research.

0 favorites 0 likes
#chat-templates

peculiar-ragdoll/Qwen-Sharp-Chat-Templates

Hugging Face Models Trending ↗ · 2026-08-10 Cached

This article describes a drop-in chat template fix for Qwen AI models that improves accuracy, reduces token usage, and speeds up responses for knowledge work and coding tasks.

0 favorites 0 likes
#chat-templates

Google is updating Gemma 4's chat templates, bringing major fixes to tool calling and reducing "laziness", and enabling Flash Attention 4 on Hopper GPUs, plus an interactive guide on how to work with and improve its vision!

Reddit r/LocalLLaMA ↗ · 2026-07-15 Cached

Google updated Gemma 4's chat templates with major fixes to tool calling, reduced laziness, enabled Flash Attention 4 on Hopper GPUs, and released an interactive vision guide. The updates are available on Hugging Face.

0 favorites 0 likes
#chat-templates

What's in a GGUF, besides the weights – and what's still missing?

Hacker News Top ↗ · 2026-05-14 Cached

This article explores the GGUF file format used by llama.cpp for language models, highlighting its single-file convenience and the role of embedded chat templates and special tokens. It also compares different Jinja implementations and discusses what is still missing from the format.

0 favorites 0 likes
← Back to home

Submit Feedback