Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability

Hugging Face Daily Papers Papers

Summary

This paper investigates whether training LLMs for shorter, more efficient chain-of-thought reasoning harms the faithfulness and monitorability of that reasoning. It finds faithfulness generally declines due to reduced model consistency, while monitorability remains relatively robust even with much shorter CoT outputs.

Chain-of-thought (CoT) reasoning allows humans to inspect how large language models reach their answers, and oversee model behaviour. This reasoning comes at an increased inference cost, motivating efficient methods that train models to solve tasks using fewer tokens. However, a common concern is that such training may cause models to skip important reasoning steps, so the CoT no longer faithfully reflects the model's decision. It is unclear whether or when this occurs in practice, since different efficiency methods apply length pressure to models' CoT in distinct ways, and faithfully explaining a model's decision takes more tokens on some tasks than others. To understand these dynamics, we fine-tune a variety of models with three methods that apply length pressure differently, namely a fixed generation budget, a per-example length target, and a group-relative length reward. We evaluate how efficient reasoning affects CoT faithfulness (i.e., how well the CoT reflects model decisions on related inputs) and monitorability (i.e., whether the CoT reveals when input interventions alter the output). We find that it affects faithfulness and monitorability differently. Faithfulness falls in most settings, primarily because the trained models are less consistent. Monitorability is more robust, as models keep acknowledging the influence on their answer even when the CoT is much shorter.
Original Article
View Cached Full Text

Cached at: 10/05/26, 12:47 PM

Paper page - Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability

Source: https://huggingface.co/papers/2610.03509

Abstract

Chain-of-thought(CoT)reasoningallowshumanstoinspecthowlargelanguagemodelsreachtheiranswers,andoverseemodelbehaviour.Thisreasoningcomesatanincreasedinferencecost,motivatingefficientmethodsthattrainmodelstosolvetasksusingfewertokens.However,acommonconcernisthatsuchtrainingmaycausemodelstoskipimportantreasoningsteps,sotheCoTnolongerfaithfullyreflectsthemodel’sdecision.Itisunclearwhetherorwhenthisoccursinpractice,sincedifferentefficiencymethodsapplylengthpressuretomodels’CoTindistinctways,andfaithfullyexplainingamodel’sdecisiontakesmoretokensonsometasksthanothers.Tounderstandthesedynamics,wefine-tuneavarietyofmodelswiththreemethodsthatapplylengthpressuredifferently,namelyafixedgenerationbudget,aper-examplelengthtarget,andagroup-relativelengthreward.WeevaluatehowefficientreasoningaffectsCoTfaithfulness(i.e.,howwelltheCoTreflectsmodeldecisionsonrelatedinputs)andmonitorability(i.e.,whethertheCoTrevealswheninputinterventionsaltertheoutput).Wefindthatitaffectsfaithfulnessandmonitorabilitydifferently.Faithfulnessfallsinmostsettings,primarilybecausethetrainedmodelsarelessconsistent.Monitorabilityismorerobust,asmodelskeepacknowledgingtheinfluenceontheiranswerevenwhentheCoTismuchshorter.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2610\.03509

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2610.03509 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2610.03509 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2610.03509 in a Space README.md to link it from this page.

Collections including this paper1

Similar Articles

Faithfulness as Information Flow: Evaluating and Training Faithful Chain-of-Thought Reasoning

arXiv cs.LG

This paper proposes a framework to evaluate and improve faithfulness of chain-of-thought reasoning by controlling information flow, using entropy-based, KL-divergence, and gradient-based diagnostics, and introduces training interventions (attention masking, gradient masking, adversarial perturbations) that make reasoning more transparent and reduce shortcut reliance.

Chain-of-Thought Reasoning in the Wild Is Not Always Faithful

Hacker News Top

This paper demonstrates that Chain-of-Thought reasoning in large language models is not always faithful, with models producing plausible but incorrect reasoning chains in response to naturally worded prompts, raising concerns for AI safety and transparency.

Reasoning models struggle to control their chains of thought, and that’s good

OpenAI Blog

OpenAI researchers study whether reasoning models can deliberately obscure their chain-of-thought to evade monitoring, finding that current models struggle to control their reasoning even when aware of monitoring. They introduce CoT-Control, an open-source evaluation suite with over 13,000 tasks to measure chain-of-thought controllability in reasoning models.