Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework
Summary
UL-XCoT introduces a unified logic space to prune low-quality multilingual reasoning paths, cutting >50% token cost while improving accuracy and robustness on low-resource languages.
View Cached Full Text
Cached at: 04/23/26, 10:03 AM
# Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework
Source: [https://arxiv.org/html/2604.20090](https://arxiv.org/html/2604.20090)
Chenyuan Zhang1,6Qiguang Chen211footnotemark:1Xie Chen5,6Zhuotao Tian1Bowen Xing4 Meishan Zhang1Libo Qin1,2,3Baotian Hu1Min Zhang1 1Harbin Institute of Technology, Shenzhen 2Central South University 3Text Computing and Cognitive Intelligence Ministry of Education Engineering Research Center, Guizhou University 4University of Science and Technology Beijing 5Shanghai Jiao Tong University 6Shanghai Innovation Institute qinlibo@hit\.edu\.cn cyzhang@stu\.hit\.edu\.cn, charleschen2333@gmail\.com
###### Abstract
Cross\-lingual chain\-of\-thought \(XCoT\) with self\-consistency markedly enhances multilingual reasoning, yet existing methods remain costly due to extensive sampling of full trajectories across languages\. Moreover, multilingual LLM representations vary strongly by language, hindering direct feature comparisons and effective pruning\. Motivated by this, we introduce UL\-XCoT, the first efficient unified logic cross\-lingual reasoning framework that minimizes redundancy in token usage and latency, yielding the greatest efficiency under limited sampling budgets during inference\. Specifically, UL\-XCoT \(1\) achieves less languages by selecting, per query, a small candidate language set in a language\-invariant unified logic space, \(2\) enables less tokens by monitoring logic\-space trajectory dynamics during decoding to prune low\-quality reasoning paths, and \(3\) aggregates the remaining high\-quality trajectories via voting\. Experiments on PolyMath across 18 languages and MMLU\-ProX\-Lite across 29 languages with DeepSeek\-R1\-Distill\-Qwen\-7B demonstrate that UL\-XCoT achieves competitive accuracy while sharply cutting over 50% decoding token cost versus prior sampling baselines\. UL\-XCoT also delivers more stable gains on low\-resource languages, underscoring consistently superior robustness where standard XCoT self\-consistency method fails\.
Less Languages, Less Tokens: An Efficient Unified Logic Cross\-lingual Chain\-of\-Thought Reasoning Framework
Chenyuan Zhang1,6††thanks:Equal contribution\.Qiguang Chen211footnotemark:1Xie Chen5,6Zhuotao Tian1Bowen Xing4Meishan Zhang1Libo Qin1,2,3††thanks:Corresponding author\.Baotian Hu1Min Zhang11Harbin Institute of Technology, Shenzhen2Central South University3Text Computing and Cognitive Intelligence Ministry ofEducation Engineering Research Center, Guizhou University4University of Science and Technology Beijing5Shanghai Jiao Tong University6Shanghai Innovation Instituteqinlibo@hit\.edu\.cncyzhang@stu\.hit\.edu\.cn, charleschen2333@gmail\.com
## 1Introduction
Figure 1:Traditional XCoT Sampling framework \(a\) generates complete reasoning trajectories with all languages \(e\.g\., Chinese, English, German, French, and Thai\)\. In contrast, Unified Logic XCoT \(UL\-XCoT\) Efficient Sampling framework \(b\) uses the Unified Logic Mechanism for efficient language selection and selective trajectories generation\.Multilingual large language models \(MLLMs\) have shown strong reasoning and generalization abilities\(Qin et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib29); Chen et al\.,[2024a](https://arxiv.org/html/2604.20090#bib.bib9); Lai et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib24); Resck et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib33)\), which Cross\-lingual chain\-of\-thought \(XCoT\) can further optimize\. Specifically, XCoT is a reasoning paradigm where inputs and intermediate steps use different languages\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28); Zhang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib51); Huang et al\.,[2026](https://arxiv.org/html/2604.20090#bib.bib19); Tran et al\.,[2025b](https://arxiv.org/html/2604.20090#bib.bib37)\), effectively activating their core reasoning capabilities\(Ahuja et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib2); Chen et al\.,[2024b](https://arxiv.org/html/2604.20090#bib.bib11); Huang et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib18)\)\.
As multilingual reasoning research advances, XCoT has attracted growing interest for test\-time scaling via self\-consistency, which samples multiple complete trajectories and aggregates outputs\(Tran et al\.,[2025a](https://arxiv.org/html/2604.20090#bib.bib36); Khairi et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib20); Ghosh et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib14); Zhang et al\.,[2025b](https://arxiv.org/html/2604.20090#bib.bib50)\)\. Specifically,Qin et al\. \([2023](https://arxiv.org/html/2604.20090#bib.bib28)\)use voting across multiple XCoT trajectories to exploit cross\-lingual complementarities\.Zhang et al\. \([2024](https://arxiv.org/html/2604.20090#bib.bib51)\)optimize instructions to select matching languages and assign language\-specific voting weights during aggregation\.Ranaldi et al\. \([2024](https://arxiv.org/html/2604.20090#bib.bib31)\)prompt the model to simulate multilingual experts, generate diverse trajectories, and derive answers via cross\-referencing\.Khairi et al\. \([2025](https://arxiv.org/html/2604.20090#bib.bib20)\)apply temperature scaling and Bayesian risk to sample and select high\-quality XCoT trajectories\.
While existing test\-time scaling strategies on XCoT have improved reasoning consistency and performance, they remain limited by computational inefficiency\. As shown in Figure[1](https://arxiv.org/html/2604.20090#S1.F1)\(a\), most prior approaches suffer from two drawbacks: \(1\)full\-language sampling, which requires generating all candidate languages, and \(2\)full\-trace reasoning, which requires generating all complete reasoning paths during inference\. These issues cause redundant computation on ineffective languages or similar reasoning trajectories, leading inference costs to grow linearly with the number of languages and producing substantial redundant tokens\.
Motivated by this, we propose theUnified Logic Cross\-lingual Chain\-of\-Thought \(UL\-XCoT\) self\-consistency framework, which enhances XCoT efficiency via two modules: Candidate Language Selection \(CLS\) and Dynamic CoT Pruning \(DCP\)\. As shown in Figure[1](https://arxiv.org/html/2604.20090#S1.F1)\(b\), UL\-XCoT first utilizes a Unified Logic Mechanism \(ULM\) to establish a unified logical representation space to compare and filter reasoning processes across languages on a shared scale\. It then applies CLS to evaluate candidate languages in this space and select a small subset\(less languages\)most relevant to the input query, reducing computation from irrelevant ones\. Next, during reasoning, DCP tracks each language’s CoT evolution and dynamically prunes redundant paths\(less tokens\)that are logically inconsistent\. Finally, voting on the remaining high\-quality cross\-lingual reasoning paths cuts costs while preserving reasoning quality\.
Experiments on PolyMath across 18 languages and on MMLU\-ProX\-Lite across 29 languages show that UL\-XCoT performs an obvious accuracy\-efficiency trade\-off with DeepSeek\-R1\-Distill\-Qwen\-7B\. On PolyMath, it attains competitive difficulty\-weighted accuracy while consistently requiring the fewest generated tokens and the lowest latency across languages, reducing the average token count by more than 50% relative to AUTOCAP and by more than 65% relative to SC\. Beyond mathematical reasoning, UL\-XCoT also generalizes well to MMLU\-ProX\-Lite, where it improves average accuracy while retaining clear efficiency advantages in both token usage and latency\. Moreover, UL\-XCoT yields stronger and more stable gains on a data\-driven low\-resource language subset, indicating greater robustness when standard prompting and sampling signals are weak\.
Overall, the contributions of the paper are summarized as follows:
- •We first point out an inherent efficiency limitation in the previous cross\-lingual ensemble reasoning paradigm, where full\-language enumeration implicitly assumes that the reasoning process in each language is equally important and must be fully generated, leading to substantial redundant computation\.
- •We introduce UL\-XCoT, an efficient XCoT self\-consistency framework improving inference efficiency from two dimensions: \(1\) less languages through efficient language selection, and \(2\) less tokens through dynamic pruning with early stopping during reasoning\.
- •Experimental results show that UL\-XCoT significantly reduces inference cost while preserving accuracy, and yields particularly strong gains in low\-resource languages\.
## 2Method
Figure 2:Overall framework of UL\-XCoT, containing \(i\) The Unified Logic Mechanism, \(ii\) Candidate Language Selection, \(iii\) Dynamic Chain\-of\-Thought Pruning modules\.In this section, we illustrate UL\-XCoT\. As illustrated in Figure[2](https://arxiv.org/html/2604.20090#S2.F2), given an input queryxxwritten in languageℓ\\ell, UL\-XCoT introduces aUnified Logic Mechanismthat makes reasoning states across different languages comparable and measurable\.
### 2\.1Overall Pipeline
Formally, letℒ=\{ℓ1,…,ℓM\}\\mathcal\{L\}=\\\{\\ell\_\{1\},\\ldots,\\ell\_\{M\}\\\}denote the set of all languages,fθf\_\{\\theta\}an MLLM, and𝒜\\mathcal\{A\}the answer space\. The overall inference process yieldsa^=UL\-XCoTθ\(x\|fθ\)∈𝒜\\hat\{a\}=\\textsc\{UL\-XCoT\}\_\{\\theta\}\(x\|f\_\{\\theta\}\)\\in\\mathcal\{A\}\. Specifically, this process comprises four stages:
- •First, in order to achieve cross\-lingual comparability of reasoning states in a unified logic space, we construct a unified logic mechanism via a projection operatorPshared\(m\)P^\{\(m\)\}\_\{\\text\{shared\}\}at layermm\.
- •Second, we select a candidate languages setℒpar\(x\),\\mathcal\{L\}\_\{\\text\{par\}\}\(x\),guided by an understanding similarity score under the unified logic mechanism, thereby achieving less languages\.
- •Third, for eachℓ∈ℒpar\(x\)\\ell\\in\\mathcal\{L\}\_\{\\text\{par\}\}\(x\), we perform XCoT decoding withfθf\_\{\\theta\}, generating trajectoryxℓx\_\{\\ell\}token by token in parallel\. During decoding, a time\-evolving confidence signal dynamically prunes low\-quality paths, yielding a retained subset of languages𝒮\(x\)⊆ℒpar\(x\)\\mathcal\{S\}\(x\)\\subseteq\\mathcal\{L\}\_\{\\text\{par\}\}\(x\)\. The remaining trajectories are denoted byS∗\(x\)=\{xℓ:ℓ∈𝒮\(x\)\}S^\{\*\}\(x\)=\\\{x\_\{\\ell\}:\\ell\\in\\mathcal\{S\}\(x\)\\\}\. In this way, we can achieve less tokens during decoding\.
- •Finally, we extract an answeraℓa\_\{\\ell\}from each surviving trajectory and aggregate them via a voting operatorVV: a^=V\(\{aℓ:ℓ∈𝒮\(x\)\}\)\.\\hat\{a\}=V\\\!\\left\(\\\{a\_\{\\ell\}:\\ell\\in\\mathcal\{S\}\(x\)\\\}\\right\)\.\(1\)
Below, we describe: \(1\) the Unified Logic Mechanism \(ULM\) for constructing the unified logic space, \(2\) Candidate Language Selection \(CLS\) for formingℒpar\(x\)\\mathcal\{L\}\_\{\\text\{par\}\}\(x\), and \(3\) Dynamic Chain\-of\-Thought Pruning \(DCP\) for obtainingS∗\(x\)S^\{\*\}\(x\)\.
### 2\.2The Unified Logic Mechanism
To fairly compare reasoning behaviors across languages, we need a unified representation space that suppresses language\-specific surface variations while preserving task\-relevant reasoning structures\. We thus construct aunified logic space, where the signals act as decision criteria for CLS \(Sec\.[2\.3](https://arxiv.org/html/2604.20090#S2.SS3)\) and DCP \(Sec\.[2\.4](https://arxiv.org/html/2604.20090#S2.SS4)\)\.
Motivated by evidence that latent representations encode both linguistic structure and reasoning\-relevant signals\(Zhao et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib52); Hao et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib16); Feng et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib12)\), we use the transformation of embeddings for constructing the Unified Logic Mechanism\. LetHm\(xℓ\)∈ℝdH\_\{m\}\(x\_\{\\ell\}\)\\in\\mathbb\{R\}^\{d\}denote the hidden state at Transformer layermmfor samplexℓx\_\{\\ell\}expressed under languageℓ∈ℒ\\ell\\in\\mathcal\{L\}\. To characterize systematic language\-dependent shifts, we use a fixed validation set𝒳val=\{xℓii\}i=1N\\mathcal\{X\}\_\{\\text\{val\}\}=\\\{x^\{i\}\_\{\\ell\_\{i\}\}\\\}\_\{i=1\}^\{N\}and obtain language\-specific realizations of the same content for eachℓ\\ell\(e\.g\., by translation or consistent prompting\)\. We then define a language center at layermmas
μℓ\(m\)=1\|𝒳val\|∑xℓi∈𝒳valHm\(xℓi\)\.\\mu^\{\(m\)\}\_\{\\ell\}=\\frac\{1\}\{\|\\mathcal\{X\}\_\{\\text\{val\}\}\|\}\\sum\_\{x^\{i\}\_\{\\ell\}\\in\\mathcal\{X\}\_\{\\text\{val\}\}\}H\_\{m\}\(x^\{i\}\_\{\\ell\}\)\.\(2\)Stacking centers across languages yields a multilingual shift matrix
M\(m\)=\[μℓ1\(m\),μℓ2\(m\),…,μℓ\|ℒ\|\(m\)\]∈ℝd×\|ℒ\|\.M^\{\(m\)\}=\\big\[\\mu^\{\(m\)\}\_\{\\ell\_\{1\}\},\\,\\mu^\{\(m\)\}\_\{\\ell\_\{2\}\},\\,\\ldots,\\,\\mu^\{\(m\)\}\_\{\\ell\_\{\|\\mathcal\{L\}\|\}\}\\big\]\\in\\mathbb\{R\}^\{d\\times\|\\mathcal\{L\}\|\}\.\(3\)Following the intuition that cross\-lingual variation concentrates on a low\-dimensional subspace, we extract its principal directions via SVD:
M\(m\)=U\(m\)Σ\(m\)V\(m\)⊤\.M^\{\(m\)\}=U^\{\(m\)\}\\Sigma^\{\(m\)\}V^\{\(m\)\\top\}\.\(4\)Letrrbe a hyperparameter\. We take the top\-rrleft singular vectors as an orthonormal basis of the language\-variation subspace:
Blang\(m\)=U:,1:r\(m\)\.B^\{\(m\)\}\_\{\\text\{lang\}\}=U^\{\(m\)\}\_\{:,1:r\}\.\(5\)Its orthogonal complement defines the cross\-lingually shared subspace, with projection operator
Pshared\(m\)=I−λBlang\(m\)Blang\(m\)⊤\.P^\{\(m\)\}\_\{\\text\{shared\}\}=I\-\\lambda B^\{\(m\)\}\_\{\\text\{lang\}\}B^\{\(m\)\\top\}\_\{\\text\{lang\}\}\.\(6\)For any input, we obtain its unified\-logic\-space representation by projection:
H~m\(xℓ\)=Pshared\(m\)h\(m\)\(xℓ\)\.\\tilde\{H\}\_\{m\}\(x\_\{\\ell\}\)=P^\{\(m\)\}\_\{\\text\{shared\}\}h^\{\(m\)\}\(x\_\{\\ell\}\)\.\(7\)
### 2\.3Candidate Language Selection
Candidate Language Selection \(CLS\) compares inputs across languages in the unified logic space for pre\-screening\. Since it requires no generation, hidden states in this space capture a unified understanding of the input\. We compute an understanding similarity score for each language and select the top\-kkas screening candidates\.
##### Understanding Similarity Score
To quantify cross\-lingual understanding consistency, we define an understanding similarity score in the unified logic space\. For input queryxℓx\_\{\\ell\}in source languageℓ\\elland each candidate target languageℓ′∈ℒ\\ell^\{\\prime\}\\in\\mathcal\{L\}, we construct a semantically equivalent renditionxℓ′x\_\{\\ell^\{\\prime\}\}\. At analysis layerm=am=a, we extract the last\-token projected representationsH~a\(xℓ\)\\tilde\{H\}\_\{a\}\(x\_\{\\ell\}\)andH~a\(xℓ′\)\\tilde\{H\}\_\{a\}\(x\_\{\\ell^\{\\prime\}\}\)in the unified logic space as the model’s understanding states\. We define the Understanding Similarity Score \(USS\) as:
USS\(xℓ,xℓ′\)≜⟨H~a\(xℓ\),H~a\(xℓ′\)⟩‖H~a\(xℓ\)‖2‖H~a\(xℓ′\)‖2\.\\mathrm\{USS\}\(x\_\{\\ell\},x\_\{\\ell^\{\\prime\}\}\)\\triangleq\\frac\{\\langle\\tilde\{H\}\_\{a\}\(x\_\{\\ell\}\),\\,\\tilde\{H\}\_\{a\}\(x\_\{\\ell^\{\\prime\}\}\)\\rangle\}\{\\\|\\tilde\{H\}\_\{a\}\(x\_\{\\ell\}\)\\\|\_\{2\}\\ \\\|\\tilde\{H\}\_\{a\}\(x\_\{\\ell^\{\\prime\}\}\)\\\|\_\{2\}\}\.\(8\)This metric quantifies the preservation of identical understanding states across languages\.
##### Candidate Set Selection
We select the top\-kklanguages according to this score:
ℒpar\(xℓ\)=Top\-kℓ′∈ℒUSS\(xℓ,xℓ′\)\.\\mathcal\{L\}\_\{\\text\{par\}\}\(x\_\{\\ell\}\)=\\text\{Top\-\}k\_\{\\ell^\{\\prime\}\\in\\mathcal\{L\}\}\\,\\mathrm\{USS\}\(x\_\{\\ell\},x\_\{\\ell^\{\\prime\}\}\)\.\(9\)It performs parallel XCoT sampling only overℒpar\(xℓ\)\\mathcal\{L\}\_\{\\text\{par\}\}\(x\_\{\\ell\}\)\. By enabling direct cross\-lingual comparison in the unified logic space, this pre\-filtering step is query\-adaptive and reduces redundant tokens generated while preserving effective cross\-lingual collaboration during inference\.
### 2\.4Dynamic Chain\-of\-Thought Pruning
Dynamic Chain\-of\-Thought Pruning \(DCP\) monitors reasoning during XCoT decoding within the unified logic space and prunes low\-quality paths online\. This eliminates redundant generation from inconsistent or drifting trajectories, focusing computation on coherent high\-quality paths\.
##### Logical Quality Score
We introduce a warm\-up phase of lengthTwarmT\_\{\\text\{warm\}\}, during which pruning is disabled to avoid discarding paths prematurely\. After warm\-up, letStS\_\{t\}denote the reasoning path from 0 tott\-th step\. For each path inStS\_\{t\}with languageℓ\\ell, we track its trajectory and compute a cohort score “score\(t\)\(⋅\|ℓ\)\\texttt\{score\}^\{\(t\)\}\(\\cdot\|\\ell\)” fromt0t\_\{0\}\-th step over a window of lengthτ\\tau\. The Logical Quality Score \(LQS\) is111Details are in Appendix[A](https://arxiv.org/html/2604.20090#A1)\.:
LQS\(St\|xℓ,ℓ′\)≜∫t=t0t0\+τscore\(St\|xℓ,ℓ′\)\.\\mathrm\{LQS\}\(S\_\{t\}\|x\_\{\\ell\},\\ell^\{\\prime\}\)\\triangleq\\int\_\{t=t\_\{0\}\}^\{t\_\{0\}\+\\tau\}\\texttt\{score\}\(S\_\{t\}\|x\_\{\\ell\},\\ell^\{\\prime\}\)\.\(10\)
##### Low Quality Path Pruning\.
At the end of the monitoring window \(TE=Twarm\+τ\+1T\_\{E\}=T\_\{\\mathrm\{warm\}\}\+\\tau\+1\), we collect the trace set𝒮\\mathcal\{S\}by retaining the top\-k′k^\{\\prime\}paths ranked byLQS\(ℓ\)\\mathrm\{LQS\}\(\\ell\):
𝒮\(xℓ\)=Top\-kℓ′∈ℒpar\(xℓ\)′LQS\(St\|xℓ,ℓ′\),\\mathcal\{S\}\(x\_\{\\ell\}\)\\;=\\;\\text\{Top\-\}k^\{\{\}^\{\\prime\}\}\_\{\\ell^\{\\prime\}\\in\\mathcal\{L\}\_\{\\text\{par\}\}\(x\_\{\\ell\}\)\}\\ \\mathrm\{LQS\}\(S\_\{t\}\|x\_\{\\ell\},\\ell^\{\\prime\}\),\(11\)wherek′k^\{\\prime\}follows pruning ratioρ\\rho\. Remaining paths terminate early, while retained paths continue decoding and aggregate via voting\. This adaptively allocates compute to coherent paths, reducing redundancy and ensuring robustness\.
## 3Experiments
Figure 3:Average decoding token cost during generation on PolyMath\.Figure 4:Average end\-to\-end latency across languages during generation on PolyMath\.### 3\.1Experimental Setting
##### Benchmark\.
We mainly evaluate on PolyMathWang et al\. \([2025d](https://arxiv.org/html/2604.20090#bib.bib43)\), a multilingual mathematical reasoning benchmark with 18 parallel languages and 4 difficulty levels\.
To test generalization, we further select a complementary benchmark on MMLU\-ProX\-Lite\(Xuan et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib47)\), a multilingual multiple\-choice benchmark spanning broader knowledge and reasoning categories\.
##### Evaluation protocol\.
We assess both effectiveness and efficiency: \(1\)Accuracy:All methods use the same backbone and decoding constraints; for SC and AUTOCAP, we control the sample budget at UL\-XCoT’s worst\-case level\. We follow PolyMath in reporting DW\-ACC\. \(2\)Efficiency:We measure inference cost via generated tokens and wall\-clock latency under identical conditions\.
##### Experimental setup\.
We conduct all experiments with DeepSeek\-R1\-Distill\-Qwen\-7BGuo et al\. \([2025](https://arxiv.org/html/2604.20090#bib.bib15)\)\. All runs are executed on NVIDIA RTX A6000 GPUs \(48 GB\)\. We set the maximum generation length in the interval of 2048–10240 according to PolyMath difficulty and stability of its performance\. For prompting, we use aconcise\-reasoning template222The prompt is provided in Appendix[D](https://arxiv.org/html/2604.20090#A4)\.for our method and baseline\.
##### UL\-XCoT configuration\.
We setλ=0\.4\\lambda=0\.4, use layerm=13m=13for logic\-space representations \(Section[2\.3](https://arxiv.org/html/2604.20090#S2.SS3)\), set\|ℒpar\(x\)\|=9\|\\mathcal\{L\}\_\{\\text\{par\}\}\(x\)\|=9–12, and use a warm\-up stage withTwarm=10T\_\{\\text\{warm\}\}=10\. After warm\-up, we compute trajectory signals in a sliding windowτ=3c\\tau=3cand adjust the pruning ratioρ\\rhowithin 20%–60% throughout decoding\.
##### Baselines\.
We compare UL\-XCoT with representative reasoning strategies spanning single\-path prompting and sampling\-based test\-time scaling: \(i\) CLP \(CLSP333The Self\-consistency version of CLP\.\)Qin et al\. \([2023](https://arxiv.org/html/2604.20090#bib.bib28)\), a cross\-lingual prompting framework that leverages multilingual signals to improve reasoning robustness; \(ii\) CoTWei et al\. \([2022](https://arxiv.org/html/2604.20090#bib.bib44)\), standard single\-trajectory chain\-of\-thought prompting; \(iii\) SCWang et al\. \([2022](https://arxiv.org/html/2604.20090#bib.bib41)\), self\-consistency that samples diverse CoT trajectories and aggregates the answers via majority voting; \(iv\) AUTOCAPZhang et al\. \([2024](https://arxiv.org/html/2604.20090#bib.bib51)\), an adaptive variant of SC that selects languages and assigns weights for aggregation; \(v\) ST\-BoN\(Wang et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib42)\), an efficient sampling\-based method that improves test\-time scaling under a fixed budget in single\-language inference; and \(vi\) UL\-CoT, a monolingual counterpart of UL\-XCoT featuring the identical DCP module\.
### 3\.2Results for UL\-XCoT
#### 3\.2\.1The Superior Efficiency\.
Figures[3](https://arxiv.org/html/2604.20090#S3.F3)&[4](https://arxiv.org/html/2604.20090#S3.F4)compare the average decoding cost and end\-to\-end latency across languages\.
UL\-XCoT can achieve marked efficiency\.As illustrated in Figure[3](https://arxiv.org/html/2604.20090#S3.F3), UL\-XCoT consistently uses the fewest tokens across all languages, achieving the lowest average token count with over 50% reduction relative to AUTOCAP and more than 65% relative to SC\. This efficiency is mirrored in latency metrics \(Figure[4](https://arxiv.org/html/2604.20090#S3.F4)\), where UL\-XCoT also exhibits the lowest latency in most languages444A per\-difficulty breakdown of token cost and wall\-clock latency is provided in Appendix[B](https://arxiv.org/html/2604.20090#A2)\.\.
UL\-XCoT can also reduce overthinking in high\-resource languages\.As shown in Figure[3](https://arxiv.org/html/2604.20090#S3.F3), some baselines \(notablySC\) exhibit pronounced spikes in token consumption on high resource languages like English and Chinese, suggesting occasional overthinking with excessively long reasoning traces\. UL\-XCoT largely avoids such extreme outliers, providing more steady inference\-time behavior and significant measures toward cost for multilingual deployment\.
Table 1:Performance on PolyMath across 18 languages and four difficulty levels from top to bottom\.ACCarbndeenesfriditjakomsptruswtethvizhAVGPolyMath\-LowCoT\(Wei et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib44)\)52\.042\.456\.083\.272\.856\.859\.268\.041\.642\.455\.267\.271\.24\.013\.649\.659\.276\.854\.0CLP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)39\.232\.845\.658\.448\.047\.238\.446\.440\.832\.847\.252\.036\.040\.832\.845\.640\.840\.842\.5SC\(Wang et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib41)\)68\.859\.268\.888\.877\.676\.873\.678\.464\.864\.072\.073\.679\.212\.026\.466\.470\.481\.666\.8CLSP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)77\.683\.281\.681\.680\.884\.882\.481\.682\.480\.878\.481\.680\.080\.080\.883\.284\.080\.081\.4AUTOCAP\(Zhang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib51)\)80\.081\.681\.676\.884\.081\.680\.879\.281\.674\.484\.883\.281\.684\.080\.878\.483\.279\.280\.9ST\-BoN\(Wang et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib42)\)60\.062\.465\.669\.664\.872\.064\.063\.261\.661\.663\.262\.464\.860\.063\.259\.261\.663\.263\.5UL\-CoT68\.055\.268\.086\.479\.276\.071\.279\.263\.262\.473\.675\.273\.69\.624\.061\.672\.080\.065\.5UL\-XCoT81\.683\.284\.084\.882\.484\.085\.683\.284\.884\.085\.683\.285\.683\.284\.084\.083\.282\.483\.8PolyMath\-MediumCoT\(Wei et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib44)\)18\.412\.818\.421\.620\.014\.415\.216\.814\.420\.013\.616\.818\.48\.88\.014\.419\.224\.816\.4CLP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)17\.617\.616\.818\.418\.420\.015\.217\.620\.819\.216\.017\.618\.414\.414\.48\.821\.616\.817\.2SC\(Wang et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib41)\)30\.422\.427\.238\.425\.624\.822\.424\.019\.232\.017\.624\.832\.012\.012\.824\.029\.639\.225\.5CLSP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)32\.028\.833\.629\.628\.032\.831\.225\.631\.228\.830\.428\.828\.832\.030\.429\.633\.632\.030\.4AUTOCAP\(Zhang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib51)\)35\.234\.430\.424\.031\.229\.625\.626\.431\.236\.029\.628\.827\.230\.428\.025\.628\.826\.429\.4ST\-BoN\(Wang et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib42)\)20\.815\.215\.219\.222\.416\.017\.617\.617\.616\.819\.220\.014\.416\.817\.624\.019\.221\.618\.4UL\-CoT28\.025\.626\.445\.626\.424\.022\.425\.621\.636\.017\.619\.232\.013\.615\.227\.224\.043\.226\.3UL\-XCoT28\.828\.035\.232\.035\.229\.633\.628\.827\.227\.231\.228\.032\.838\.433\.629\.632\.828\.031\.1PolyMath\-HighCoT\(Wei et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib44)\)5\.66\.410\.48\.010\.48\.04\.09\.67\.28\.04\.88\.88\.00\.81\.67\.28\.812\.87\.2CLP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)7\.28\.08\.87\.26\.410\.48\.87\.212\.04\.89\.610\.48\.08\.06\.46\.46\.46\.47\.9SC\(Wang et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib41)\)14\.411\.29\.620\.012\.012\.08\.013\.68\.815\.28\.09\.610\.42\.44\.011\.29\.620\.811\.2CLSP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)15\.213\.615\.215\.216\.015\.216\.015\.216\.813\.615\.216\.816\.016\.812\.811\.214\.411\.214\.8AUTOCAP\(Zhang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib51)\)13\.613\.613\.614\.412\.820\.016\.814\.416\.812\.812\.014\.414\.412\.013\.612\.815\.212\.814\.2ST\-BoN\(Wang et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib42)\)12\.010\.48\.83\.27\.26\.48\.014\.47\.28\.810\.48\.09\.610\.47\.28\.88\.08\.08\.7UL\-CoT12\.016\.010\.429\.614\.47\.27\.212\.08\.817\.68\.010\.413\.64\.84\.011\.28\.825\.612\.3UL\-XCoT13\.611\.212\.811\.214\.415\.217\.613\.612\.811\.212\.814\.415\.214\.412\.016\.812\.812\.013\.6PolyMath\-TopCoT\(Wei et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib44)\)5\.61\.67\.22\.47\.29\.67\.23\.28\.83\.24\.88\.05\.60\.80\.86\.44\.84\.05\.1CLP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)4\.02\.48\.09\.65\.68\.85\.68\.09\.68\.88\.84\.89\.68\.06\.44\.07\.28\.87\.1SC\(Wang et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib41)\)12\.04\.87\.27\.28\.89\.68\.810\.44\.012\.89\.68\.89\.63\.23\.27\.28\.012\.08\.2CLSP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)8\.87\.212\.811\.26\.48\.812\.87\.210\.414\.49\.65\.68\.09\.611\.211\.28\.89\.69\.6AUTOCAP\(Zhang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib51)\)8\.88\.88\.89\.69\.68\.810\.46\.47\.212\.814\.49\.66\.48\.09\.65\.68\.011\.29\.1ST\-BoN\(Wang et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib42)\)7\.26\.45\.68\.85\.610\.48\.87\.210\.48\.89\.69\.67\.25\.67\.210\.410\.47\.28\.1UL\-CoT10\.49\.65\.622\.410\.410\.47\.29\.67\.215\.25\.68\.89\.63\.25\.66\.48\.021\.19\.4UL\-XCoT10\.412\.810\.412\.89\.610\.49\.69\.69\.69\.611\.28\.011\.213\.68\.811\.212\.010\.410\.6
Table 2:Ablation study for 3 proposed modules on PolyMath\-Low subset\.SubsetACC\.Latency \(s\)Tokens \(\#\)UL\-XCoT w/o CLS84\.436\.25560UL\-XCoT w/o DCP81\.430\.73893UL\-XCoT w/o ULM79\.825\.43098UL\-XCoT w/o all modules85\.235\.97518UL\-XCoT83\.824\.63092
#### 3\.2\.2The Comparable Performance\.
Table[1](https://arxiv.org/html/2604.20090#S3.T1)&[4](https://arxiv.org/html/2604.20090#A2.T4)provide a comparative evaluation of UL\-XCoT against a range of multilingual reasoning baselines on PolyMath555The overall performance is provided in Appendix[C](https://arxiv.org/html/2604.20090#A3)\.
UL\-XCoT achieves competitive accuracy\.Under the same evaluation setting, UL\-XCoT delivers consistently strong performance across languages and four difficulty levels, ranking at or near the top on average\. Table[4](https://arxiv.org/html/2604.20090#A2.T4)shows competitive DW\-ACC on PolyMath\-Full across all difficulties, confirming effectiveness on challenging problems\. Overall, UL\-XCoT provides robust gains over prior prompting and sampling\-based baselines for cross\-lingual mathematical reasoning\.
UL\-XCoT also shows robustness in low\-resource languages\.We evaluate robustness on a data\-driven low\-resource subset\(Bandarkar et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib4)\), performed as languages where bothCoTandSCfall below their mean DW\-ACC across all languages\. On this challenging set, UL\-XCoT remains consistently strong performance, indicating more stable and reliable cross\-lingual reasoning when language resources are limited\.
The multilingual gain does not collapse to pruning alone\.To separate the effect of multilingual collaboration from the gain brought by pruning, we further introduce a monolingual control variant,UL\-CoT\. This variant keeps the same unified logic representation and dynamic pruning signals as UL\-XCoT, but samples and aggregates reasoning traces only within the query language\. As shown in Table[1](https://arxiv.org/html/2604.20090#S3.T1), UL\-XCoT consistently outperforms UL\-CoT across all four PolyMath difficulty levels,
indicating that the benefit of UL\-XCoT does not come only from pruning more efficiently; multilingual interaction itself contributes substantial performance gains, especially on lower\-resource languages\.
Table 3:Additional benchmark results on MMLU\-ProX\-Lite across 29 languages\.LanguagesafarbncsdeenesfrhihuiditjakomrneptrusrswtethukurviwoyozhzuAVGCLSP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)37\.344\.132\.244\.142\.439\.040\.742\.435\.637\.347\.537\.339\.044\.142\.435\.642\.444\.140\.739\.037\.342\.437\.337\.345\.842\.444\.142\.439\.040\.5UL\-XCoT40\.739\.052\.540\.740\.749\.252\.540\.739\.042\.444\.145\.845\.839\.040\.742\.442\.445\.845\.842\.440\.745\.849\.239\.042\.445\.845\.842\.442\.443\.6
Figure 5:Average token cost and end\-to\-end latency across languages during generation on MMLU\-ProX\-Lite\.
#### 3\.2\.3The Robust Generalization\.
UL\-XCoT transfers beyond PolyMath\.To complement the main PolyMath evaluation, we compare UL\-XCoT and CLSP on MMLU\-ProX\-Lite\(Xuan et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib47)\)under the same evaluation protocol\. This benchmark covers a broader set of multilingual knowledge\-and\-reasoning multiple\-choice questions, providing a task setting distinct from multilingual math reasoning\. As shown in Table[3](https://arxiv.org/html/2604.20090#S3.T3), UL\-XCoT improves the average accuracy from 40\.5 to 43\.6, outperforms CLSP in 19 of 29 languages, and ties in 2 languages\. And the gains also extend to several lower\-resource languages, suggesting that the method can generalize across multilingual reasoning tasks\.
UL\-XCoT retains its efficiency advantage on the new benchmark\.Figure[5](https://arxiv.org/html/2604.20090#S3.F5)reports the generated tokens and end\-to\-end latency across the 29 languages\. UL\-XCoT reduces average token usage from 27,679\.3 to 10,543\.6 and average latency from 134\.2 s to 93\.7 s\. This result is consistent with our main findings: candidate language selection and dynamic pruning avoid unnecessary multilingual sampling, yielding a better cost–quality trade\-off than CLSP even on a different task\.
### 3\.3Analysis
#### 3\.3\.1Effectiveness of Each Module
To quantify the contribution of each module, we carry out ablation studies on PolyMath\-Low
by removing one module at a time666Variants without CLS or DCP may implicitly use more compute, which can inflate accuracy; hence accuracy should be read together with compute\.in Table[2](https://arxiv.org/html/2604.20090#S3.T2)\.
##### ULM is the main accuracy contributor under a matched compute budget\.
A key observation from Table[2](https://arxiv.org/html/2604.20090#S3.T2)is that UL\-XCoT and UL\-XCoT w/o ULM operate under nearly identical compute budgets \(24\.6s/3092 tokens vs\. 25\.4s/3098 tokens\)\. Therefore, the accuracy drop after removing ULM reflects a genuine algorithmic gain rather than an artifact of increased sampling or longer decoding\. Mechanistically, ULM maps language\-specific chains into a unified, comparable logic space, enabling reliable cross\-lingual confidence accumulation and coherent trajectory selection without increasing tokens and latency\.
##### CLS primarily improves efficiency by reducing the search space\.
CLS mainly improves efficiency by proactively shrinking the candidate language set to a few logically relevant participants, reducing exploration over noisy or irrelevant paths\. As shown in Table[2](https://arxiv.org/html/2604.20090#S3.T2), removing CLS enlarges the active set and leads to higher latency and tokens, indicating that CLS saves compute by avoiding low\-value multilingual trajectories early\.
Figure 6:PCA projection of same\-query embedding representations across 18 languages\. Circles denote the original representations, while crosses indicate ULM\-transformed representations in the unified logic space\.Figure 7:Layer\-wise evolution of decoding embeddings measured by L2 distance and Angular across transformer layers\. For each layer, we report the sample\-wise extrema \(min/max\) to visualize the variation range\. Purple denotes the model with ULM, while blue denotes the model without ULM\.
##### DCP saves compute via online pruning of low\-quality trajectories\.
DCP further reduces computation through early truncation: it monitors trajectory quality online and stops paths that show clear signs of low utility\. And they do not continue consuming the full decoding budget\. This strategy shrinks the active set early and focuses computation on the remaining competitive candidates during inference time\. From Table[2](https://arxiv.org/html/2604.20090#S3.T2), removing DCP substantially increases token usage and latency, while yielding only limited gains in final performance\. These results suggest that many additional steps generated without DCP are largely redundant and rarely translate into better final votes\.
#### 3\.3\.2ULM can effectively unify cross\-lingual logic representations\.
To assess how ULM unifies cross\-lingual logical representations, we analyze \(1\) static alignment across languages and \(2\) dynamic decoding trajectories under ULM\.
ULM disentangles static language\-specific variation\.To visualize static alignment, we extract logic\-space embeddings for the same query across 18 languages at a fixed decoding step and project them into 2D using PCA\. Figure[6](https://arxiv.org/html/2604.20090#S3.F6)shows that ULM of UL\-XCoT disentangles surface\-form variation, producing comparable, language\-invariant representations across languages\. After removing language\-specific components, embeddings exhibit greater invariance: cross\-lingual samples cluster tightly with consistent nearest neighbors\. This indicates that the retained subspace encodes a shared logic state, not superficial differences\.
ULM can align dynamic reasoning trajectories\.Beyond static alignment, Figure[7](https://arxiv.org/html/2604.20090#S3.F7)tracks how hidden\-state geometry evolves across layers when answering the same queries in different languages\.
With ULM, trajectories show a consistent distribution across languages, reflecting shared evolution patterns in the logic space\. Without ULM, trajectories diverge markedly, with greater sensitivity and larger geometric gaps due to linguistic difference\. Thus, ULM removes superficial variation, enabling DCP’s chain\-of\-thought pruning via reliable geometric signals in the unified logic space\.
Figure 8:Distribution of languages selected by CLS, measured by the frequency of each language appearing inℒpar\(x\)\\mathcal\{L\}\_\{\\text\{par\}\}\(x\)over the full evaluation suite\.
#### 3\.3\.3CLS can adaptively select appropriate languages without bias\.
As shown in Figure[8](https://arxiv.org/html/2604.20090#S3.F8), we count how often each language appears in the CLS\-selected setℒpar\(x\)\\mathcal\{L\}\_\{\\text\{par\}\}\(x\)across the full evaluation suite\. CLS does not collapse to a single language: each language contributes roughly3\.7%∼7\.7%3\.7\\%\\\!\\sim\\\!7\.7\\%of all selections \(mean≈5\.6%\\approx 5\.6\\%\), indicating broad coverage without a dominant bias\. While a few languages \(e\.g\., pt/ms/ru/it/id\) are selected slightly more often, CLS still consistently includes lower\-frequency languages \(e\.g\., bn/ar/te/zh\) for a non\-trivial portion of inputs, reflecting query\-adaptive selection rather than a fixed or heuristic language list\.



Figure 9:Impact of the pruning ratioρ\\rhoon accuracy \(left\), latency \(middle\), and generated tokens \(right\)\.
#### 3\.3\.4DCP enables quality\-aware pruning for efficiency\.
##### DCP can effectively balance performance and efficiency\.
To assess the impact of the pruning ratioρ\\rhoin DCP, we varyρ\\rhofrom 0\.0 to 0\.9 and measure both accuracy and efficiency\. As shown in Figure[9](https://arxiv.org/html/2604.20090#S3.F9), forρ<0\.85\\rho<0\.85, higherρ\\rhoslightly degrades accuracy but yields an almost linear reduction in latency and token usage, indicating that DCP removes low\-confidence paths with minimal quality loss\. Overall, a moderateρ\\rhoof 0\.55–0\.70 provides the best trade\-off, achieving substantial efficiency gains while largely preserving performance\.
Figure 10:Quality comparison between trajectories pruned by DCP \(Pruned XCoT\) and those retained in Full XCoT, scored by an LLM judge over five criteria\.
##### DCP can truly prune low\-quality paths\.
To verify DCP’s pruning quality, we analyze a high\-performing subset where both Pruned and Full XCoT achieve strong overall performance\. As shown in Figure[10](https://arxiv.org/html/2604.20090#S3.F10), we use an LLM\-as\-a\-judge777The prompt is provided in Appendix[D](https://arxiv.org/html/2604.20090#A4)to score trajectories \(0–100\) on step validity, faithfulness, completeness, conciseness, and compliance\. Pruned trajectories consistently score lower, with the largest drops in step validity and completeness, indicating weaker logical coherence and more missing intermediate reasoning\.
## 4Related Work
### 4\.1Cross\-lingual Chain\-of\-Thought Reasoning
Chain\-of\-Thought \(CoT\) prompting elicits explicit intermediate steps, improving reliability on multi\-step problems\(Wei et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib44); Kojima et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib21); Qin et al\.,[2026](https://arxiv.org/html/2604.20090#bib.bib27); Chen et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib10)\)\. In cross\-lingual settings, CoT can transfer across languages and strengthen in underrepresented languages as model scale grows\(Shi et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib34); Ghosh et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib14); Barua et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib5); He et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib17)\)\. This motivates XCoT to go beyond prompt translation and exploit multilingual signals\(Huang et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib18); Wang et al\.,[2025a](https://arxiv.org/html/2604.20090#bib.bib39); Chai et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib6); Ahuja et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib2)\)\. Recently, XCoT studies instruction tuning for CoT transfer, distilling reasoning from high\-resource to low\-resource languages\(Upadhayay and Behzadan,[2023](https://arxiv.org/html/2604.20090#bib.bib38); Kuulmets et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib22); Chai et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib6); Weihua et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib45)\)\.
### 4\.2Cross\-lingual Chain\-of\-Thought Self\-consistency
Self\-consistency improves CoT by sampling multiple paths and selecting the most consistent answer\(Wang et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib41); Aggarwal et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib1); Wang et al\.,[2025b](https://arxiv.org/html/2604.20090#bib.bib40)\)\.
Cross\-lingual self\-consistent prompting extends this to XCoT paths\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\), while AUTOCAP automates language selection and learns language\-specific weights\(Zhang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib51)\)\. Cross\-lingual Tree\-of\-Thoughts performs multilingual search with branching reasoning and aggregation\(Ranaldi et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib31)\)\.L2L^\{2\}leverages multilingual unification learning and decoding\-time interventions\(Chen et al\.,[2025b](https://arxiv.org/html/2604.20090#bib.bib8)\)\. Best\-of\-L ranks multilingual candidates with a cross\-lingual reward model for math reasoning\(Rajaee et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib30)\)and Multidimensional Consistency aggregates signals across input perturbations to improve robustness\(Lai et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib23)\)\.
Compared to these methods, our focus is efficiency\-oriented allocation of test\-time computation\. We align intermediate states across languages in a unified logic space, which makes partial reasoning trajectories directly comparable during decoding and enables query\-adaptive language selection together with online pruning\.
## 5Conclusion
We proposed UL\-XCoT, an efficient cross\-lingual reasoning framework that leverages a unified logic mechanism to better allocate compute resources\. By selecting query\-adaptive candidate languages and pruning inconsistent XCoT dynamically, UL\-XCoT reduces redundancy at both the language and token levels while maintaining strong cross\-lingual reasoning quality\.
Experiments on PolyMath and MMLU\-ProX\-Lite show competitive accuracy with significantly higher efficiency and stable gains on a data\-driven low\-resource subset\.
## Limitations
Prior interpretability work suggests that transformer hidden states encode information\-rich representations that can be meaningfully inspected and analyzed\(Yang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib48); Ghandeharioun et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib13); Skean et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib35)\)\. Our method builds on this observation by leveraging hidden\-state representations to compare cross\-lingual understanding differences in a unified logic space and to monitor the quality of reasoning trajectories for online pruning\. Therefore, UL\-XCoT assumes white\-box access to hidden states\. Applicability to strict black\-box LLM APIs remains to be validated\.
## Acknowledgement
This work was supported by the National Natural Science Foundation of China \(NSFC\) via grants 92570120 and 62306342\. This work was supported by the Scientific Research Fund of Hunan Provincial Education Department \(24B0001\)\. This work was sponsored by the Excellent Young Scientists Fund in Hunan Province \(2024JJ4070\), the Science and Technology Innovation Program of Hunan Province under Grant 2024RC3024\. This study was also funded by the Open Project of the Text Computing and Cognitive Intelligence Ministry of Education Engineering Research Center \(No\. TCCI250101\)\.
## References
- Aggarwal et al\. \(2023\)Pranjal Aggarwal, Aman Madaan, Yiming Yang, et al\. 2023\.Let’s sample step by step: Adaptive\-consistency for efficient reasoning and coding with llms\.In*Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing*, pages 12375–12396\.
- Ahuja et al\. \(2025\)Sanchit Ahuja, Praneetha Vaddamanu, and Barun Patra\. 2025\.Efficientxlang: Towards improving token efficiency through cross\-lingual reasoning\.In*Findings of the Association for Computational Linguistics: EMNLP 2025*, pages 15612–15624\.
- Bae et al\. \(2023\)Sangmin Bae, Jongwoo Ko, Hwanjun Song, and Se\-Young Yun\. 2023\.Fast and robust early\-exiting framework for autoregressive language models with synchronized parallel decoding\.In*Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing*, pages 5910–5924\.
- Bandarkar et al\. \(2024\)Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, and Madian Khabsa\. 2024\.The belebele benchmark: a parallel reading comprehension dataset in 122 language variants\.In*Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pages 749–775\.
- Barua et al\. \(2025\)Josh Barua, Seun Eisape, Kayo Yin, and Alane Suhr\. 2025\.Long chain\-of\-thought reasoning across languages\.*arXiv preprint arXiv:2508\.14828*\.
- Chai et al\. \(2025\)Linzheng Chai, Jian Yang, Tao Sun, Hongcheng Guo, Jiaheng Liu, Bing Wang, Xinnian Liang, Jiaqi Bai, Tongliang Li, Qiyao Peng, et al\. 2025\.xcot: Cross\-lingual instruction tuning for cross\-lingual chain\-of\-thought reasoning\.In*Proceedings of the AAAI Conference on Artificial Intelligence*, volume 39, pages 23550–23558\.
- Chen et al\. \(2025a\)Kang Chen, Yaoning Wang, Kai Xiong, Zhuoka Feng, Wenhe Sun, Haotian Chen, and Yixin Cao\. 2025a\.Do llms signal when they’re right? evidence from neuron agreement\.*arXiv preprint arXiv:2510\.26277*\.
- Chen et al\. \(2025b\)Kang Chen, Mengdi Zhang, and Yixin Cao\. 2025b\.Less data less tokens: Multilingual unification learning for efficient test\-time reasoning in llms\.*arXiv preprint arXiv:2506\.18341*\.
- Chen et al\. \(2024a\)Nuo Chen, Zinan Zheng, Ning Wu, Ming Gong, Dongmei Zhang, and Jia Li\. 2024a\.Breaking language barriers in multilingual mathematical reasoning: Insights and observations\.In*Findings of the Association for Computational Linguistics: EMNLP 2024*, pages 7001–7016\.
- Chen et al\. \(2025c\)Qiguang Chen, Libo Qin, Jinhao Liu, Dengyun Peng, Jiannan Guan, Peng Wang, Mengkang Hu, Yuhang Zhou, Te Gao, and Wanxiang Che\. 2025c\.Towards reasoning era: A survey of long chain\-of\-thought for reasoning large language models\.*arXiv preprint arXiv:2503\.09567*\.
- Chen et al\. \(2024b\)Qiguang Chen, Libo Qin, Jiaqi Wang, Jinxuan Zhou, and Wanxiang Che\. 2024b\.Unlocking the capabilities of thought: A reasoning boundary framework to quantify and optimize chain\-of\-thought\.*Advances in Neural Information Processing Systems*, 37:54872–54904\.
- Feng et al\. \(2024\)Jiahai Feng, Stuart Russell, and Jacob Steinhardt\. 2024\.Monitoring latent world states in language models with propositional probes\.*arXiv preprint arXiv:2406\.19501*\.
- Ghandeharioun et al\. \(2024\)Asma Ghandeharioun, Avi Caciularu, Adam Pearce, Lucas Dixon, and Mor Geva\. 2024\.Patchscopes: A unifying framework for inspecting hidden representations of language models\.*arXiv preprint arXiv:2401\.06102*\.
- Ghosh et al\. \(2025\)Akash Ghosh, Debayan Datta, Sriparna Saha, and Chirag Agarwal\. 2025\.A survey of multilingual reasoning in language models\.*arXiv preprint arXiv:2502\.09457*\.
- Guo et al\. \(2025\)Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, et al\. 2025\.Deepseek\-r1: Incentivizing reasoning capability in llms via reinforcement learning\.*arXiv preprint arXiv:2501\.12948*\.
- Hao et al\. \(2024\)Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason Weston, and Yuandong Tian\. 2024\.Training large language models to reason in a continuous latent space\.*arXiv preprint arXiv:2412\.06769*\.
- He et al\. \(2025\)Yifei He, Alon Benhaim, Barun Patra, Praneetha Vaddamanu, Sanchit Ahuja, Parul Chopra, Vishrav Chaudhary, Han Zhao, and Xia Song\. 2025\.Scaling laws for multilingual language models\.In*Findings of the Association for Computational Linguistics: ACL 2025*, pages 4257–4273\.
- Huang et al\. \(2023\)Haoyang Huang, Tianyi Tang, Dongdong Zhang, Wayne Xin Zhao, Ting Song, Yan Xia, and Furu Wei\. 2023\.Not all languages are created equal in llms: Improving multilingual capability by cross\-lingual\-thought prompting\.In*Findings of the Association for Computational Linguistics: EMNLP 2023*, pages 12365–12394\.
- Huang et al\. \(2026\)Kaiyu Huang, Fengran Mo, Xinyu Zhang, Hongliang Li, You Li, Yuanchi Zhang, Weijian Yi, Yulong Mao, Jinchen Liu, Yuzhuang Xu, et al\. 2026\.A survey on large language models with multilingualism: Recent advances and new frontiers\.*Artificial Intelligence Review*\.
- Khairi et al\. \(2025\)Ammar Khairi, Daniel D’souza, Ye Shen, Julia Kreutzer, and Sara Hooker\. 2025\.When life gives you samples: The benefits of scaling up inference compute for multilingual llms\.In*Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing*, pages 27547–27571\.
- Kojima et al\. \(2022\)Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa\. 2022\.Large language models are zero\-shot reasoners\.*Advances in neural information processing systems*, 35:22199–22213\.
- Kuulmets et al\. \(2024\)Hele\-Andra Kuulmets, Taido Purason, Agnes Luhtaru, and Mark Fishel\. 2024\.Teaching llama a new language through cross\-lingual knowledge transfer\.In*Findings of the Association for Computational Linguistics: NAACL 2024*, pages 3309–3325\.
- Lai et al\. \(2025\)Huiyuan Lai, Xiaoyu Zhang, and Malvina Nissim\. 2025\.Multidimensional consistency improves reasoning in language models\.*arXiv preprint arXiv:2503\.02670*\.
- Lai et al\. \(2023\)Viet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, Hieu Man, Franck Dernoncourt, Trung Bui, and Thien Huu Nguyen\. 2023\.Chatgpt beyond english: Towards a comprehensive evaluation of large language models in multilingual learning\.In*Findings of the Association for Computational Linguistics: EMNLP 2023*, pages 13171–13189\.
- Li et al\. \(2024\)Haitao Li, Qian Dong, Junjie Chen, Huixue Su, Yujia Zhou, Qingyao Ai, Ziyi Ye, and Yiqun Liu\. 2024\.Llms\-as\-judges: a comprehensive survey on llm\-based evaluation methods\.*arXiv preprint arXiv:2412\.05579*\.
- OpenAI \(2024\)OpenAI\. 2024\.Gpt\-4o mini: advancing cost\-efficient intelligence\.OpenAI Blog\.Accessed: 2026\-01\-05\.
- Qin et al\. \(2026\)Libo Qin, Qiguang Chen, Xiachong Feng, Yang Wu, Yongheng Zhang, Yinghui Li, Min Li, Wanxiang Che, and Philip S Yu\. 2026\.Large language models meet nlp: A survey\.*Frontiers of Computer Science*, 20\(11\):2011361\.
- Qin et al\. \(2023\)Libo Qin, Qiguang Chen, Fuxuan Wei, Shijue Huang, and Wanxiang Che\. 2023\.Cross\-lingual prompting: Improving zero\-shot chain\-of\-thought reasoning across languages\.In*Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing*, pages 2695–2709\.
- Qin et al\. \(2025\)Libo Qin, Qiguang Chen, Yuhang Zhou, Zhi Chen, Yinghui Li, Lizi Liao, Min Li, Wanxiang Che, and Philip S Yu\. 2025\.A survey of multilingual large language models\.*Patterns*, 6\(1\)\.
- Rajaee et al\. \(2025\)Sara Rajaee, Rochelle Choenni, Ekaterina Shutova, et al\. 2025\.Best\-of\-l: Cross\-lingual reward modeling for mathematical reasoning\.*arXiv preprint arXiv:2509\.15811*\.
- Ranaldi et al\. \(2024\)Leonardo Ranaldi, Giulia Pucci, Federico Ranaldi, Elena Sofia Ruzzetti, and Fabio Massimo Zanzotto\. 2024\.A tree\-of\-thoughts to broaden multi\-step reasoning across languages\.In*Findings of the Association for Computational Linguistics: NAACL 2024*, pages 1229–1241\.
- Renze and Guven \(2024\)Matthew Renze and Erhan Guven\. 2024\.The benefits of a concise chain of thought on problem\-solving in large language models\.*arXiv preprint arXiv:2401\.05618*\.
- Resck et al\. \(2025\)Lucas Resck, Isabelle Augenstein, and Anna Korhonen\. 2025\.Explainability and interpretability of multilingual large language models: A survey\.In*Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing*, pages 20465–20497\.
- Shi et al\. \(2022\)Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, et al\. 2022\.Language models are multilingual chain\-of\-thought reasoners\.*arXiv preprint arXiv:2210\.03057*\.
- Skean et al\. \(2025\)Oscar Skean, Md Rifat Arefin, Dan Zhao, Niket Patel, Jalal Naghiyev, Yann LeCun, and Ravid Shwartz\-Ziv\. 2025\.Layer by layer: Uncovering hidden representations in language models\.*arXiv preprint arXiv:2502\.02013*\.
- Tran et al\. \(2025a\)Khanh\-Tung Tran, Barry O’Sullivan, and Hoang D Nguyen\. 2025a\.Scaling test\-time compute for low\-resource languages: Multilingual reasoning in llms\.*arXiv e\-prints*, pages arXiv–2504\.
- Tran et al\. \(2025b\)Khanh\-Tung Tran, Nguyet\-Hang Vu, Barry O’Sullivan, and Harry Nguyen\. 2025b\.Disentangling language understanding and reasoning structures in cross\-lingual chain\-of\-thought prompting\.In*EMNLP 2025*\.
- Upadhayay and Behzadan \(2023\)Bibek Upadhayay and Vahid Behzadan\. 2023\.Taco: Enhancing cross\-lingual transfer for low\-resource languages in llms through translation\-assisted chain\-of\-thought processes\.*arXiv preprint arXiv:2311\.10797*\.
- Wang et al\. \(2025a\)Teng Wang, Zhenqi He, Wing\-Yin Yu, Xiaojin Fu, and Xiongwei Han\. 2025a\.Large language models are good multi\-lingual learners: When llms meet cross\-lingual prompts\.In*Proceedings of the 31st International Conference on Computational Linguistics*, pages 4442–4456\.
- Wang et al\. \(2025b\)Weiqin Wang, Yile Wang, and Hui Huang\. 2025b\.Ranked voting based self\-consistency of large language models\.In*Findings of the Association for Computational Linguistics: ACL 2025*, pages 14410–14426\.
- Wang et al\. \(2022\)Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou\. 2022\.Self\-consistency improves chain of thought reasoning in language models\.*arXiv preprint arXiv:2203\.11171*\.
- Wang et al\. \(2025c\)Yiming Wang, Pei Zhang, Siyuan Huang, Baosong Yang, Zhuosheng Zhang, Fei Huang, and Rui Wang\. 2025c\.Sampling\-efficient test\-time scaling: Self\-estimating the best\-of\-n sampling in early decoding\.*arXiv preprint arXiv:2503\.01422*\.
- Wang et al\. \(2025d\)Yiming Wang, Pei Zhang, Jialong Tang, Haoran Wei, Baosong Yang, Rui Wang, Chenshu Sun, Feitong Sun, Jiran Zhang, Junxuan Wu, et al\. 2025d\.Polymath: Evaluating mathematical reasoning in multilingual contexts\.*arXiv preprint arXiv:2504\.18428*\.
- Wei et al\. \(2022\)Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al\. 2022\.Chain\-of\-thought prompting elicits reasoning in large language models\.*Advances in neural information processing systems*, 35:24824–24837\.
- Weihua et al\. \(2025\)Zheng Weihua, Roy Ka\-Wei Lee, Zhengyuan Liu, Wu Kui, Aiti Aw, and Bowei Zou\. 2025\.Ccl\-xcot: An efficient cross\-lingual knowledge transfer method for mitigating hallucination generation\.In*Findings of the Association for Computational Linguistics: EMNLP 2025*, pages 1768–1788\.
- Xu et al\. \(2025\)Silei Xu, Wenhao Xie, Lingxiao Zhao, and Pengcheng He\. 2025\.Chain of draft: Thinking faster by writing less\.*arXiv preprint arXiv:2502\.18600*\.
- Xuan et al\. \(2025\)Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, Jinghui Lu, Yuang Jiang, Huitao Li, Xin Li, Kunyu Yu, Ruihai Dong, Shangding Gu, Yuekang Li, Xiaofei Xie, Felix Juefei\-Xu, Foutse Khomh, Osamu Yoshie, Qingyu Chen, Douglas Teodoro, Nan Liu, Randy Goebel, Lei Ma, Edison Marrese\-Taylor, Shijian Lu, Yusuke Iwasawa, Yutaka Matsuo, and Irene Li\. 2025\.[MMLU\-ProX: A multilingual benchmark for advanced large language model evaluation](https://doi.org/10.18653/v1/2025.emnlp-main.79)\.In*Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing*, pages 1513–1532, Suzhou, China\. Association for Computational Linguistics\.
- Yang et al\. \(2024\)Rui Yang, Ruomeng Ding, Yong Lin, Huan Zhang, and Tong Zhang\. 2024\.Regularizing hidden states enables learning generalizable reward model for llms\.*Advances in Neural Information Processing Systems*, 37:62279–62309\.
- Zhang et al\. \(2025a\)Anqi Zhang, Yulin Chen, Jane Pan, Chen Zhao, Aurojit Panda, Jinyang Li, and He He\. 2025a\.Reasoning models know when they’re right: Probing hidden states for self\-verification\.*arXiv preprint arXiv:2504\.05419*\.
- Zhang et al\. \(2025b\)Qiyuan Zhang, Fuyuan Lyu, Zexu Sun, Lei Wang, Weixu Zhang, Wenyue Hua, Haolun Wu, Zhihan Guo, Yufei Wang, Niklas Muennighoff, et al\. 2025b\.A survey on test\-time scaling in large language models: What, how, where, and how well?*arXiv preprint arXiv:2503\.24235*\.
- Zhang et al\. \(2024\)Yongheng Zhang, Qiguang Chen, Min Li, Wanxiang Che, and Libo Qin\. 2024\.Autocap: Towards automatic cross\-lingual alignment planning for zero\-shot chain\-of\-thought\.In*Findings of the Association for Computational Linguistics: ACL 2024*, pages 9191–9200\.
- Zhao et al\. \(2025\)Weixiang Zhao, Jiahe Guo, Yang Deng, Tongtong Wu, Wenxuan Zhang, Yulin Hu, Xingyu Sui, Yanyan Zhao, Wanxiang Che, Bing Qin, et al\. 2025\.When less language is more: Language\-reasoning disentanglement makes llms better multilingual reasoners\.*arXiv preprint arXiv:2505\.15257*\.
- Zheng et al\. \(2023\)Lianmin Zheng, Wei\-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric Xing, et al\. 2023\.Judging llm\-as\-a\-judge with mt\-bench and chatbot arena\.*Advances in neural information processing systems*, 36:46595–46623\.
## Appendix AMathematical Details of DCP
##### Logic\-space curvature signal\.
Building upon hidden\-state based self\-truncation ideas\(Wang et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib42); Zhang et al\.,[2025a](https://arxiv.org/html/2604.20090#bib.bib49); Bae et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib3); Chen et al\.,[2025a](https://arxiv.org/html/2604.20090#bib.bib7)\), we quantify the within\-model stability of a trajectory by measuring the curvature of projected hidden states across layers at each decoding step\. After warm\-up, at decoding momenttt, for each active language pathℓ\\ell, letxℓtx\_\{\\ell\}^\{t\}denote the current prefix\. Letm∈ℳ=\{ms,…,me\}m\\in\\mathcal\{M\}=\\\{m\_\{s\},\\ldots,m\_\{e\}\\\}be the monitored Transformer layers\. We define the position\-averaged projected hidden state:
ht,mℓ≔H^mt\(xℓ\)\.h\_\{t,m\}^\{\\ell\}\\coloneqq\\hat\{H\}\_\{m\}^\{t\}\(x\_\{\\ell\}\)\.H^mt\(x,ℓ\)=1\|xℓt\|∑i=1\|xℓt\|H~i,mt\(x,ℓ\)\.\\hat\{H\}\_\{m\}^\{t\}\(x,\\ell\)=\\frac\{1\}\{\|x\_\{\\ell\}^\{t\}\|\}\\sum\_\{i=1\}^\{\|x\_\{\\ell\}^\{t\}\|\}\\tilde\{H\}^\{t\}\_\{i,m\}\(x,\\ell\)\.whereH~i,mt\(x,ℓ\)\\tilde\{H\}^\{t\}\_\{i,m\}\(x,\\ell\)is the projected hidden state at token positioniiand layermm\.
We quantify layer\-to\-layer local changes in magnitude and direction\. Define cosine similarity:
cos\(u,v\)≔u⊤v∥u∥∥v∥\.\\operatorname\{cos\}\(u,v\)\\coloneqq\\frac\{u^\{\\top\}v\}\{\\lVert u\\rVert\\,\\lVert v\\rVert\}\.For each adjacent layer pair\(m−1,m\)\(m\-1,m\), define the magnitude change:
δM\(t,m\)\(ℓ\)≔‖ht,mℓ−ht,m−1ℓ‖2\.\\delta\_\{M\}^\{\(t,m\)\}\(\\ell\)\\coloneqq\\left\\lVert h\_\{t,m\}^\{\\ell\}\-h\_\{t,m\-1\}^\{\\ell\}\\right\\rVert\_\{2\}\.Define the angular change:
δA\(t,m\)\(ℓ\)≔arccos\(cos\(ht,mℓ,ht,m−1ℓ\)\)\.\\delta\_\{A\}^\{\(t,m\)\}\(\\ell\)\\coloneqq\\arccos\\\!\\big\(\\operatorname\{cos\}\(h\_\{t,m\}^\{\\ell\},h\_\{t,m\-1\}^\{\\ell\}\)\\big\)\.
We normalize by the end\-to\-end \(chord\) change across layers at the same steptt\. Define:
ΔMt\(ℓ\)≔‖ht,meℓ−ht,msℓ‖2\.\\Delta\_\{M\}^\{t\}\(\\ell\)\\coloneqq\\left\\lVert h\_\{t,m\_\{e\}\}^\{\\ell\}\-h\_\{t,m\_\{s\}\}^\{\\ell\}\\right\\rVert\_\{2\}\.ΔAt\(ℓ\)≔arccos\(cos\(ht,meℓ,ht,msℓ\)\)\.\\Delta\_\{A\}^\{t\}\(\\ell\)\\coloneqq\\arccos\\\!\\big\(\\operatorname\{cos\}\(h\_\{t,m\_\{e\}\}^\{\\ell\},h\_\{t,m\_\{s\}\}^\{\\ell\}\)\\big\)\.The layer\-wise curvature ratios are:
rMt\(ℓ\)≔∑m=ms\+1meδM\(t,m\)\(ℓ\)ΔMt\(ℓ\)\.r\_\{M\}^\{t\}\(\\ell\)\\coloneqq\\frac\{\\sum\_\{m=m\_\{s\}\+1\}^\{m\_\{e\}\}\\delta\_\{M\}^\{\(t,m\)\}\(\\ell\)\}\{\\Delta\_\{M\}^\{t\}\(\\ell\)\}\.rAt\(ℓ\)≔∑m=ms\+1meδA\(t,m\)\(ℓ\)ΔAt\(ℓ\)\.r\_\{A\}^\{t\}\(\\ell\)\\coloneqq\\frac\{\\sum\_\{m=m\_\{s\}\+1\}^\{m\_\{e\}\}\\delta\_\{A\}^\{\(t,m\)\}\(\\ell\)\}\{\\Delta\_\{A\}^\{t\}\(\\ell\)\}\.
Finally, we define aLogic\-space curvature signalto measure the evolution of a path:
κt\(ℓ\)≔rMt\(ℓ\)−rAt\(ℓ\)\.\\kappa^\{t\}\(\\ell\)\\coloneqq r\_\{M\}^\{t\}\(\\ell\)\-r\_\{A\}^\{t\}\(\\ell\)\.
Divergence test\.To avoid false positives caused by a global drift shared by all paths, we implement an indicator𝕀κt\\mathbb\{I\}\_\{\\kappa\}tusing both absolute and relative pairwise spread\. Specifically, define the maximum absolute spread
Δmaxt≔maxℓ≠ℓ′\|κt\(ℓ\)−κt\(ℓ′\)\|,\\Delta\_\{\\max\}^\{t\}\\coloneqq\\max\_\{\\ell\\neq\\ell^\{\\prime\}\}\\big\|\\kappa^\{t\}\(\\ell\)\-\\kappa^\{t\}\(\\ell^\{\\prime\}\)\\big\|,the maximum relative spread
Rmaxt≔maxℓ≠ℓ′\|κt\(ℓ\)−κt\(ℓ′\)\|max\(\|κt\(ℓ\)\|,\|κt\(ℓ′\)\|,δ\),R\_\{\\max\}^\{t\}\\coloneqq\\max\_\{\\ell\\neq\\ell^\{\\prime\}\}\\frac\{\\big\|\\kappa^\{t\}\(\\ell\)\-\\kappa^\{t\}\(\\ell^\{\\prime\}\)\\big\|\}\{\\max\\\!\\big\(\|\\kappa^\{t\}\(\\ell\)\|,\\ \|\\kappa^\{t\}\(\\ell^\{\\prime\}\)\|,\\ \\delta\\big\)\},and the mean relative spread over all unordered pairs can be expressed as
Rmeant≔𝔼ℓ≠ℓ′\[\|κt\(ℓ\)−κt\(ℓ′\)\|max\(\|κt\(ℓ\)\|,\|κt\(ℓ′\)\|,δ\)\],R\_\{\\mathrm\{mean\}\}^\{t\}\\coloneqq\\mathbb\{E\}\_\{\\ell\\neq\\ell^\{\\prime\}\}\\left\[\\frac\{\\big\|\\kappa^\{t\}\(\\ell\)\-\\kappa^\{t\}\(\\ell^\{\\prime\}\)\\big\|\}\{\\max\\\!\\big\(\|\\kappa^\{t\}\(\\ell\)\|,\\ \|\\kappa^\{t\}\(\\ell^\{\\prime\}\)\|,\\ \\delta\\big\)\}\\right\],whereδ\>0\\delta\>0is a small constant for numerical stability\. We declare stepttasdivergentiff all three conditions hold:
𝕀κt\\displaystyle\\mathbb\{I\}\_\{\\kappa\}^\{t\}=𝕀\[Δmaxt\>εabs\]⋅𝕀\[Rmaxt\>εrel\]\\displaystyle=\\mathbb\{I\}\\\!\\left\[\\Delta\_\{\\max\}^\{t\}\>\\varepsilon\_\{\\mathrm\{abs\}\}\\right\]\\cdot\\mathbb\{I\}\\\!\\left\[R\_\{\\max\}^\{t\}\>\\varepsilon\_\{\\mathrm\{rel\}\}\\right\]⋅𝕀\[Rmaxt≥γRmeant\]\.\\displaystyle\\quad\\cdot\\mathbb\{I\}\\\!\\left\[R\_\{\\max\}^\{t\}\\geq\\gamma\\,R\_\{\\mathrm\{mean\}\}^\{t\}\\right\]\.
##### Divergence detection and scoring\.
LetSt∗S\_\{t\}^\{\*\}denote the set of active paths at decoding stepttandNt=\|St\|N\_\{t\}\\\!=\\\!\|S\_\{t\}\|\. For each pathℓ∈St\\ell\\in S\_\{t\}, letκt\(ℓ\)\\kappa^\{t\}\(\\ell\)be its divergence descriptor at steptt\. We start monitoring after a warm\-up period and define the first post\-warm\-up divergence step as
c≔min\{t≥Twarm∣𝕀κt=1\}\.c\\coloneqq\\min\\\{\\,t\\geq T\_\{\\mathrm\{warm\}\}\\mid\\mathbb\{I\}\_\{\\kappa\}^\{t\}=1\\,\\\}\.We only score paths within a fixed window
t∈\[c,c\+τ\]\.t\\in\[c,\\,c\+\\tau\]\.
##### Per\-step point assignment\.
We setKt′≔min\(K′,Nt\)K\_\{t\}^\{\\prime\}\\coloneqq\\min\(K^\{\\prime\},N\_\{t\}\)and assign each pathℓ∈St\\ell\\in S\_\{t\}a binary pointscore\(St\|xℓ,ℓ′\)∈\{0,1\}\\texttt\{score\}\(S\_\{t\}\|x\_\{\\ell\},\\ell^\{\\prime\}\)\\in\\\{0,1\\\}:
\{𝕀\[ℓ∈Rt\],𝕀κt=0,𝕀\[ℓ∈Wt\],𝕀κt=1,\\displaystyle\(12\)
where, if stepttis non\-divergent, we sampleRt⊆StR\_\{t\}\\subseteq S\_\{t\}uniformly at random without replacement with\|Rt\|=K′\|R\_\{t\}\|=K^\{\\prime\}\. If stepttis divergent, we keep theK′K^\{\\prime\}most central paths by minimizing the average distance to the cohort in the divergence space:
gt\(ℓ\)≔1max\(1,Nt−1\)∑ℓ′∈St∖\{ℓ\}\|κt\(ℓ\)−κt\(ℓ′\)\|g^\{t\}\(\\ell\)\\coloneqq\\frac\{1\}\{\\max\(1,N\_\{t\}\-1\)\}\\sum\_\{\\ell^\{\\prime\}\\in S\_\{t\}\\setminus\\\{\\ell\\\}\}\\big\|\\kappa^\{t\}\(\\ell\)\-\\kappa^\{t\}\(\\ell^\{\\prime\}\)\\big\|Wt≔TopK′ℓ∈St\(−gt\(ℓ\)\)\.W\_\{t\}\\coloneqq\\operatorname\{TopK^\{\\prime\}\}\_\{\\,\\ell\\in S\_\{t\}\}\\\!\\big\(\-g^\{t\}\(\\ell\)\\big\)\.Equivalently,WtW\_\{t\}contains theKt′K\_\{t\}^\{\\prime\}paths with the smallestgt\(ℓ\)g^\{t\}\(\\ell\), with ties broken arbitrarily\.
\(a\)PolyMath\-low
\(b\)PolyMath\-medium
\(c\)PolyMath\-high
\(d\)PolyMath\-top
Figure 11:Decoding token cost during generation across PolyMath difficulty levels\.\(a\)PolyMath\-low
\(b\)PolyMath\-medium
\(c\)PolyMath\-high
\(d\)PolyMath\-top
Figure 12:Decoding wall\-clock latency during generation across PolyMath difficulty levels\.
## Appendix BDetailed Efficiency Analysis
This appendix analyzes the efficiency results in Sec\.[3\.2\.1](https://arxiv.org/html/2604.20090#S3.SS2.SSS1)by PolyMath difficulty level, providing additional evidence for the less languages, less tokens motivation\.
### B\.1Token cost across difficulty levels\.
Figure[11](https://arxiv.org/html/2604.20090#A1.F11)reports the decoding token cost over four PolyMath difficulty levels, broken down by language\. As difficulty increases from low to top, all methods exhibit higher token consumption, indicating longer reasoning traces on harder problems\. Across all languages and levels, UL\-XCoT consistently incurs fewer tokens than the baselines, showing that query\-adaptive language selection and online trajectory pruning can reduce unnecessary generation without relying on extra sampling\. The gap becomes more evident on harder subsets \(high/top\), where baseline decoding tends to produce longer and more variable traces, while UL\-XCoT keeps token usage more stable and cost\-efficient\.
### B\.2Wall\-clock latency across difficulty levels\.
Figure[12](https://arxiv.org/html/2604.20090#A1.F12)reports decoding wall\-clock latency during generation across four PolyMath difficulty levels, broken down by language\. Latency increases monotonically from low to top for all methods, reflecting the longer and more compute\-intensive reasoning required by harder problems\. Across nearly all languages and all levels, UL\-XCoT consistently achieves the lowest latency and the best AVG, indicating a more efficient decoding profile than CLSP, AUTOCAP, and SC\. Notably, the advantage becomes more pronounced on high/top, where baseline methods exhibit larger variance and occasional long\-tail spikes, while UL\-XCoT remains more stable\. This improvement is attributed to selecting candidate languages before decoding and dynamically pruning low\-quality XCoT paths early, thereby avoiding unnecessary generation early and reducing end\-to\-end serving time\.
Table 4:Difficulty considered performance on PolyMath across 18 languages and four difficulty levels\.DW\-ACCarbndeenesfriditjakomsptruswtethvizhAVGCoT\(Wei et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib44)\)10\.47\.112\.811\.814\.113\.010\.911\.011\.39\.39\.313\.312\.32\.12\.810\.611\.414\.010\.4CLP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)9\.07\.911\.913\.410\.313\.39\.911\.613\.810\.712\.511\.112\.111\.09\.28\.111\.111\.411\.0SC\(Wang et al\.,[2022](https://arxiv.org/html/2604.20090#bib.bib41)\)18\.912\.514\.620\.216\.516\.714\.717\.611\.419\.414\.415\.517\.44\.76\.214\.515\.522\.615\.2CLSP\(Qin et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib28)\)18\.216\.920\.819\.416\.818\.820\.716\.719\.720\.518\.516\.717\.719\.218\.818\.518\.617\.718\.6AUTOCAP\(Zhang et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib51)\)18\.318\.317\.817\.318\.319\.418\.816\.117\.920\.020\.518\.316\.317\.117\.915\.017\.718\.218\.2ST\-BoN\(Wang et al\.,[2025c](https://arxiv.org/html/2604.20090#bib.bib42)\)13\.812\.411\.712\.712\.214\.213\.414\.213\.913\.414\.714\.112\.612\.012\.315\.014\.313\.113\.3UL\-XCoT18\.519\.119\.319\.719\.119\.120\.018\.117\.817\.319\.317\.420\.121\.818\.020\.019\.718\.019\.0
## Appendix COverall Performance on PolyMath
Table[4](https://arxiv.org/html/2604.20090#A2.T4)provides thePolyMath\-Fullsummary in terms ofDW\-ACC, which is the primary effectiveness metric used in our evaluation protocol\. Different from Table[1](https://arxiv.org/html/2604.20090#S3.T1)that reports accuracy separately for each difficulty level, DW\-ACCaggregatesperformance over the four levels into a single difficulty\-aware score, enabling a compact comparison of overall effectiveness across languages\.
Overall, UL\-XCoT achieves the best AVG DW\-ACC, and remains consistently strong across the 18\-language suite\. This result directly supports that our efficiency\-oriented framework substantially reduces inference cost, it stays competitive in difficulty\-weighted accuracy on PolyMath\-Full\. In particular, the gains are not confined to a single high\-resource language, but are distributed across languages, suggesting that the proposed CLS and DCP strategy guarantees cross\-lingual reasoning quality under the same decoding budget\.
## Appendix DPrompt Templates
### D\.1Concise Reasoning Prompt
We faithfully implement the reasoning setting using the following prompt, which enforces a concise thinking process and enables a clearer analysis of performance under such a regime\(Renze and Guven,[2024](https://arxiv.org/html/2604.20090#bib.bib32); Xu et al\.,[2025](https://arxiv.org/html/2604.20090#bib.bib46)\)\.
Specifically, it \(i\) fixes the reasoning language to<LANG\_NAME\>to avoid cross\-lingual leakage, \(ii\) caps the reasoning to at most<STEP\_NUM\>numbered steps to control verbosity and token budget, and \(iii\) restricts the final output to a single boxed answer outside the<think\>block, ensuring a clean separation between intermediate reasoning and the model’s final response\. This standardized format makes results comparable and isolates efficiency gains attributable to the decoding strategy rather than prompt\-induced length differences\.
concise\-reasoning templateYou are an expert in mathematical / geometric reasoning\.Think strictly in <LANG\_NAME\> step by step\. Do not use any other language\.Format:<think\>Step 1: …Step 2: ……Step N: …</think\>$\\boxed \{FINAL\\\_ANSWER\}$Hard Rules:1\) All intermediate reasoning MUST be inside a single<think\>\.\.\.</think\>block, written only in <LANG\_NAME\>\.2\) At most <STEP\_NUM\> numbered steps\. Be concise and avoid repetition\.3\) Outside</think\>you may output ONE line only:$\\boxed \{FINAL\\\_ANSWER\}$\.4\) Do NOT restate the problem\. Do NOT add any explanation, comments, or extra text after the boxed answer\.5\) If the result is an expression, keep it simplified\. If numeric, give an exact value when possible\.Question:<QUERY\>Nnotes:\- Use standard math notation\. Keep symbols/variables as\-is\.\- If you reach a conclusion early, stop immediately and output the boxed answer\.
### D\.2Quality Judge Prompt
We use anLLM\-as\-a\-judgeprompt to score each candidate trajectory in a structured and machine\-readable manner\(Zheng et al\.,[2023](https://arxiv.org/html/2604.20090#bib.bib53); Li et al\.,[2024](https://arxiv.org/html/2604.20090#bib.bib25)\)\. We use GPT–4o mini as the LLM in our experiments\(OpenAI,[2024](https://arxiv.org/html/2604.20090#bib.bib26)\)\. The judge takes thequestion,reference\_answer,candidate\_answer, and the candidate CoT as input, and is constrained to outputonlya JSON object matching a fixed schema\. It assigns integer scores in\[0,100\]\[0,100\]on six dimensions: correctness \(exact match to the reference answer\), step validity \(logical soundness without jumps\), faithfulness \(no hallucinated facts\), completeness \(covers key constraints\), conciseness \(non\-redundant\), and compliance \(language constraints\)\. The finaloverallscore is a weighted average with the largest weight on correctness\.
quality\-judge\-promptYou are a strict grader\. Output ONLY JSON matching the schema\.Score scale \(IMPORTANT\):\- All scores are INTEGERS from 0 to 100 \(100 is best\)\.\- 0–20: very poor, 40–60: mediocre, 70–80: good, 85–95: very good, 96–100: near\-perfect\.\- DO NOT use a 1–5 scale\.Question:<question\>Reference Answer:<reference\_answer\>Candidate Answer:<candidate\_answer\>Candidate Reasoning / CoT:<candidate\_cot\>Dimension rules:\- correctness: 100 if candidate answer matches reference answer \(allow trivial formatting\), else 0\.\- step\_validity: penalize jumps/invalid inference; 100 means each step is logically justified\.\- faithfulness: penalize invented facts not in question or derivable; 100 means fully grounded\.\- completeness: 100 means all key constraints/calculations covered\.\- conciseness: 100 means no redundancy; lower if repetitive\.\- compliance: 100 means follows required format/language constraints\.overall: weighted average \(correctness has the largest weight\)\.Similar Articles
MUX: Continuous Reasoning via Multiplexed Tokens
MUX proposes a method for lossless continuous reasoning by distilling discrete reasoning steps into multiplexed latent tokens that encode a superposition of subwords, achieving higher bandwidth and enabling parallel exploration in language model reasoning tasks.
Crosslingual On-Policy Self-Distillation for Multilingual Reasoning
The paper proposes Crosslingual On-Policy Self-Distillation (COPSD), a method to transfer high-resource language reasoning capabilities to low-resource languages using a shared student-teacher architecture. Experiments across 17 African languages show significant improvements in mathematical reasoning and answer-format adherence, outperforming Group Relative Policy Optimization (GRPO).
SuperThoughts: Reasoning Tokens in Superposition
SuperThoughts compresses consecutive chain-of-thought tokens into latent representations and decodes two tokens per step, achieving ~20–30% CoT length reduction with minimal accuracy loss on math reasoning benchmarks, while doubling inference throughput.
When LLMs Develop Languages: Symbolic Communication for Efficient Multi-Agent Reasoning
This paper introduces Communicative Language Symbolism Routing (CLSR), where multiple LLM agents autonomously invent and evolve compact symbolic languages for reasoning, achieving 3-6x token reduction over chain-of-thought while maintaining accuracy.
Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages
Introduces OSCD, a post-training algorithm to improve native multilingual chain-of-thought reasoning in low-resource Southeast Asian languages, achieving up to 3.2x improvements on math benchmarks.