temperature

A developer shares lessons learned when making an AI that analyzes trading charts give consistent answers. The fix involves setting temperature to 0 and using a fixed seed across all pipeline stages, and emphasizes that determinism is a trust feature that must be paired with grounding against ground truth.

Google's Gemini models are deprecating and ignoring the temperature, top_p, and top_k parameters, likely simplifying inference configuration.

This article presents a technique to improve LLM creative writing by modifying the sampling process using entropy, aiming to reduce the generic 'LLM feel' in generated text.

This tweet explores the relationship between statistical mechanics and artificial intelligence, citing a paper that proposes a thermodynamic theory for machine learning systems, introducing concepts like temperature, entropy, and energy, and treating the training process as a phase transition.

Recommended a deep guide on modern LLM sampling mechanisms, covering methods such as Temperature, Top-P, Mirostat, etc., of significant reference value for developers aiming to improve output quality.

An educational overview of knowledge distillation, covering its history, core concepts like softmax and temperature, types, scaling laws, and practical examples including DeepSeek-R1.

A suitcase robot uses a real gas sensor to live-adjust LLM sampler parameters (temperature, top_p, top_k) based on smoke detection, causing the robot's speech to become more unpredictable and loop-free.

This paper reexamines the role of temperature in large language model distillation, revealing that temperature asymmetrically benefits forward KL divergence over reverse KL, allowing simple KL methods to match state-of-the-art distillation approaches at higher temperatures.

Proposes CIST, a method that assigns separate sample-wise adaptive temperatures to teacher and student in knowledge distillation, producing consistently informative soft labels and relaxing rigid logit-scale matching. Experiments on vision and language tasks show consistent improvements over standard KD.