reasoning-traces

The author describes an experiment where AI agents like Claude Code and Codex are given a workbook to document their decisions and tradeoffs during tasks, exploring the potential use of these reasoning traces as a signal for distillation.

This article explains how reasoning traces work in AI models, discussing their implementation, concealment, and extraction techniques, with examples from models like GPT-OSS and DeepSeek.

A recent paper demonstrates a technique to retrieve hidden reasoning traces from proprietary LLM APIs like Claude and GPT, with implications for open-source model comparisons, benchmark integrity, and distillation efforts.

This paper demonstrates a method to extract hidden reasoning traces from proprietary LLM APIs (Anthropic, OpenAI, Google) by replaying encrypted chain-of-thought blocks into weaker, jailbroken sibling models, recovering the stronger model's raw reasoning verbatim without attacking it directly.

A user shares observations about Muse-Glimmer's reasoning traces, noting they appear disorganized and repetitive compared to Qwen and Gemma models, and asks the community about their experiences.

A researcher discusses rumors that Chinese labs reverse-engineered reasoning traces from Claude Code and Codex to improve open-weights models, and shares a paper on Trace Inversion models that can reconstruct reasoning traces from outputs.

LLM 0.32 adds visible reasoning traces, server-side tools, new GPT-5.6 models, and redesigned logging, plus a new llm openai endpoint command for any OpenAI-compatible endpoint.

This paper extracts implicit theories of literary quality from reasoning-enabled LLMs by analyzing their reasoning traces when rating texts from Nobel literature to forum posts, and tests these theories via systematic degradation of literary passages. The models show greater sensitivity to structure and voice than vocabulary.

Anthropic releases research on a global workspace in language models, prompted by observations that Claude has unspoken thoughts in reasoning traces.

Lior On AI argues that high-quality reasoning traces are the new bottleneck in AI. A team distilled 2.3M reasoning traces from Claude Fable 5 into Qwen3-4B, achieving perfect self-consistency and zero hallucination variance, and open-sourced the result.

Using 2.3 million pieces of Claude inference trajectory data to distill the Qwen3-4B model, resulting in a small model with 100% output consistency and extremely low hallucination. Moreover, the student model was not limited by the teacher model, and it also converged to a universal truth.

VeryTrace is a zero-shot verification-and-repair framework that formalizes LLM reasoning traces into a compilable representation using a DSL, enabling step-level error localization through a hybrid of deterministic checks and LLM audits. It improves accuracy across math, robotics, and relational reasoning without domain-specific training.

The tweet outlines a 3-step loop for LLM training in 2026: train on data, run evals, and add synthetic data for underperforming tasks. It emphasizes the accessibility of legal distillation via open source models and cheap APIs, noting that training on reasoning traces alone can achieve high scores.

The article discusses a shift in LLM reasoning research from making reasoning explicit via chain-of-thought to exploring latent reasoning that doesn't require language traces, questioning whether visibility is necessary for effective reasoning.

Introduces ReasoningFlow, a framework to capture discourse structures of large language model reasoning traces as directed acyclic graphs, enabling fine-grained analysis of reasoning behaviors like self-reflection and backtracking. Based on manual and automatic annotation of thousands of traces, it reveals structural similarities across models and that most erroneous steps do not contribute to final answers.

This paper argues that consensus-seeking in multi-agent LLM systems is insufficient for value-laden tasks, proposing a knowledge-representation layer that classifies agent reasoning-trace disagreements into four symbolic states to enable strategic routing in systems like content moderation.

ReasonOps introduces an unsupervised method for annotating chain-of-thought traces from large reasoning models, identifying 7 recurring reasoning operators. The method enables analysis of reasoning structure, model identification, and correctness prediction across 12 models and 8 benchmarks.

This paper reveals that aggregating complete reasoning traces from multiple LLM agents, rather than just their final answers, can correct errors even when agents unanimously agree, introducing the 'aggregation paradox' and the Self-Consistent Mixture of Agents method.

User tested Gemma 4 2B running locally via LM Studio and Spring AI for structured JSON output, tool calling, and reasoning traces, finding it correctly identified a Java bug in code review and performed comparably to larger models.

This paper introduces the concept of 'minimal cores' in overcomplete reasoning traces, showing that on average 46% of steps can be removed while preserving the final answer, and that minimal cores improve trace separation and reduce intrinsic dimensionality.