Constraint-First Reasoning: A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solving

# A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solving
Source: [https://arxiv.org/html/2608.05254](https://arxiv.org/html/2608.05254)
Hongbo Ma1,∗, Bangji Yang2,∗, Yunqian Selina Cheng1,∗, Jiajun Fan2, Hanwen Zhang1, Ge Liu2,† 1Tsinghua University2University of Illinois Urbana\-Champaign ∗Equal contribution†Corresponding author

###### Abstract

Large language models can derive a plausible mathematical object yet still violate explicit requirements—for example, by omitting a modular reduction, returning a non\-integer, or using the wrong encoded answer form\. We introduceConstraint\-First Reasoning\(CFR\), a training\-free two\-stage prompting protocol: Stage 1 extracts and summarizes constraints entailed by the problem, and Stage 2 solves while checking intermediate and final results against that summary\.Routed\-CFRactivates the two\-stage protocol only when a text\-only regex router detects restrictive cues; otherwise it uses direct chain\-of\-thought \(CoT\)\. Across AIME, CMIMC, BRUMO, and AIMO\_AMC, the method improves direct CoT on multiple backbones\. We further report convention\-controlled routing experiments, matched prompting baselines, problem\-level paired tests, decoding robustness, constraint\-quality audits, total\-token accounting, and an OlympiadBench evaluation\. These analyses position CFR as a targeted test\-time intervention whose benefit depends on recoverable constraints and reliable Stage 1 extraction, rather than as a general\-purpose replacement for mathematical reasoning\.

Constraint\-First Reasoning: A Training\-Free Protocol for Exploiting Answer\-Space Constraints in Mathematical Problem Solving

## 1Introduction

Competition mathematics problems embed constraints in natural language: “find the remainder whenNNis divided by 1000,” “how many positive integers satisfy…,” “express your answer asp\+qp\+qwhereppandqqare coprime\.” These constraints define the*feasible answer region*—a small, structured subset of all possible values\. A solver that ignores them risks producing answers that violate stated requirements despite correct underlying reasoning\.

Why do constraint violations occur so frequently? We identify three root causes\. First,*attention dilution*: in long reasoning chains, early constraint information can fade before the model reaches a final answer\(Liuet al\.,[2024](https://arxiv.org/html/2608.05254#bib.bib28)\)\. Second,*implicit encoding*: models trained on solution traces handle constraints implicitly—they may notice a modular condition mid\-solution or check integer constraints post\-hoc—but this implicit handling breaks under distribution shift\. Third,*format ambiguity*: problems with encoded answer formats \(“findm\+nm\+nwheregcd⁡\(m,n\)=1\\gcd\(m,n\)=1”\) require multi\-step post\-processing that models frequently skip or misapply\.

![Refer to caption](https://arxiv.org/html/2608.05254v1/figures/constraint_wordcloud.png)Figure 1:Restrictive lexical cues in competition mathematics\.Larger words correspond to cue types emphasized by our router, including integer\-answer formats, divisibility and modular conditions, bounds, extremal operators, exactness requirements, and counting restrictions\. These cues motivate CFR: before solving, identify what any valid answer must satisfy\.Current reasoning models, trained to generate extended chains of thought\(DeepSeek\-AI,[2025](https://arxiv.org/html/2608.05254#bib.bib4); OpenAI,[2024](https://arxiv.org/html/2608.05254#bib.bib5)\), handle constraints implicitly\. A model may follow a plausible derivation while leaving answer restrictions implicit until the end; explicit constraint tracking is designed to keep those restrictions visible throughout solving\.

We proposeConstraint\-First Reasoning\(CFR\), a training\-free protocol that makes constraint handling explicit and systematic\. The key insight:*extract constraints before solving, not after*\. This mirrors human competition practice, where experienced contestants identify the required answer form before attempting a solution\(Pólya,[1945](https://arxiv.org/html/2608.05254#bib.bib29)\)\. Front\-loading constraint identification ensures the solver maintains awareness of answer\-space requirements throughout its reasoning chain\.

CFRoperates in two stages:

1. 1\.Constraint Extraction & Prompted Summary: Extract answer\-space constraints \(domain, modular, parity, bounds, format\) and problem\-structure constraints \(e\.g\., invariants or branch conditions\) from the problem statement, then summarize their implications for solving\.
2. 2\.Constraint\-Guided Solving: Solve under the extracted constraints, checking intermediate results against the constraint specification at each major step\.

We further introduceRouted\-CFR, which prepends a regex\-based router that checks whether the problem text contains restrictive lexical cues\. Problems without such cues bypass the pipeline and proceed directly to standard chain\-of\-thought reasoning\. This purely syntactic router decides whether to use the full pipeline before generation begins\.

Our experiments use Table[1](https://arxiv.org/html/2608.05254#S4.T1)and Table[3](https://arxiv.org/html/2608.05254#S5.T3)as the primary empirical evidence\. Detailed statistical, router, and error analyses are reported in the appendix\. They reveal a clear and interpretable pattern:

- •Under the text\-only router, Table[1](https://arxiv.org/html/2608.05254#S4.T1)shows positive AIME/CMIMC average gains for all four evaluated backbones; the magnitude varies with Stage 1 reliability\.
- •Table[3](https://arxiv.org/html/2608.05254#S5.T3)compares CFR with matched planning, verification, format\-only, and token\-matched prompting alternatives under a single evaluation protocol\.
- •The appendix reports pooled problem\-level analyses after removing the AIME routing convention and correcting for multiple comparisons\.
- •Table[3](https://arxiv.org/html/2608.05254#S5.T3)makes the accuracy–cost trade\-off explicit: routing reduces, but does not eliminate, the inference overhead of the two\-stage protocol\.

### 1\.1Evaluation Protocol and Method Labels

Unless explicitly stated otherwise, every accuracy in the main paper ispass@1 averaged over four independent runs\(avg@4\)\. Each run produces one answer per problem; we use the same decoding setting, answer extractor, and grading script for all methods in a comparison\. We do not use self\-consistency, majority voting, best\-of\-kkselection, or answer\-format filtering in these primary results\. For paired analyses, the four pass@1 outcomes are first averaged within each problem, so the problem—not an individual generation—is the unit of inference\. Appendix[H](https://arxiv.org/html/2608.05254#A8)retains a clearly labeled pass@4 exploratory comparison, which is not pooled with or used to substantiate the main pass@1 claims\.

We useRouted\-CFRfor the text\-only router followed by the two\-stage pipeline, andCFR \(always\-on\)for the same two\-stage pipeline without routing\. This distinction is used consistently in tables and captions\. “CFR” without a qualifier refers only to the general constraint\-first protocol, not to an ambiguous experimental variant\.

These findings positionCFRnot as a universal reasoning enhancer but as a targeted intervention for settings where answer\-space constraints are informative and the backbone can use them\.

![Refer to caption](https://arxiv.org/html/2608.05254v1/figures/framework_overview.png)Figure 2:Routed\-CFRframework overview\.Given an input problem, the regex router checks for restrictive lexical cues\. If detected, Stage 1 extracts and cross\-propagates answer\-space constraints \(domain, modular, parity, bound, format\), then Stage 2 solves under the resulting feasible set with interleaved self\-checks\. Problems without cues bypass the pipeline via direct CoT\.

## 2Related Work

### 2\.1Self\-Refinement, Planning, and Verification

Self\-Refine\(Madaanet al\.,[2023](https://arxiv.org/html/2608.05254#bib.bib13)\)iteratively improves outputs via self\-feedback\. Process reward models\(Lightmanet al\.,[2024](https://arxiv.org/html/2608.05254#bib.bib15); Wanget al\.,[2024](https://arxiv.org/html/2608.05254#bib.bib16)\)score individual reasoning steps to guide search\. Outcome reward models\(Cobbeet al\.,[2021](https://arxiv.org/html/2608.05254#bib.bib31)\)provide binary signals on final answers\. ReAct\(Yaoet al\.,[2023b](https://arxiv.org/html/2608.05254#bib.bib14)\)interleaves reasoning with actions for grounded decision\-making, while Plan\-and\-Solve\(Wanget al\.,[2023a](https://arxiv.org/html/2608.05254#bib.bib12)\)produces an explicit plan before solution generation\. Learning\-based alternatives further examine robust preference optimization, evolving sample interactions for multi\-domain fine\-tuning, noisy or verifier\-independent reasoning rewards, and policy optimization through interactive guidance\(Lianget al\.,[2025a](https://arxiv.org/html/2608.05254#bib.bib37),[b](https://arxiv.org/html/2608.05254#bib.bib38); Caiet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib39); Cai and Sugiyama,[2026](https://arxiv.org/html/2608.05254#bib.bib40); Liuet al\.,[2026](https://arxiv.org/html/2608.05254#bib.bib41)\)\. These methods respectively emphasize planning, post\-hoc refinement, verification, or policy learning\. CFR is narrower: it constructs a problem\-specific constraint summary before solving and carries that summary into the solving prompt\. It therefore does not claim to replace planning, verification, or training\-based optimization pipelines; Table[3](https://arxiv.org/html/2608.05254#S5.T3)empirically separates this design from their prompting counterparts\.

### 2\.2Test\-Time Compute Scaling

Recent work demonstrates that allocating more inference\-time computation improves performance across diverse tasks\. Best\-of\-nnsampling\(Brownet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib23)\)and compute\-optimal scaling\(Snellet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib21)\)establish scaling laws for test\-time compute\. S1\(Muennighoffet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib22)\)shows that budget forcing \(extending reasoning with “wait” tokens\) improves accuracy\. Unlike generic compute scaling,CFRconcentrates additional computation on constraint identification—a narrow task with compact output that produces high\-value information guiding the larger solving budget\.

## 3Method

### 3\.1Problem Formulation

Letqqdenote a mathematical problem,𝒜\\mathcal\{A\}the answer space,yya reasoning trace produced by the model, andπ​\(y\)\\pi\(y\)the function that extracts a final answer fromyy\. Standard inference samples:

a∗=π​\(y∗\),y∗=arg⁡max𝑦​Pθ​\(y∣q\)a^\{\*\}=\\pi\(y^\{\*\}\),\\quad y^\{\*\}=\\underset\{y\}\{\\arg\\max\}\\;P\_\{\\theta\}\(y\\mid q\)\(1\)wherePθP\_\{\\theta\}is the language model\. Many competition problems define a feasible answer regionΦ​\(q\)⊂𝒜\\Phi\(q\)\\subset\\mathcal\{A\}through explicit constraints \(e\.g\., “integer in 000–999” implies\|Φ​\(q\)\|=1000\|\\Phi\(q\)\|=1000vs\.\|𝒜\|=∞\|\\mathcal\{A\}\|=\\infty\)\.CFRmakesΦ​\(q\)\\Phi\(q\)explicit:

aCFR∗=arg⁡maxa∈Φ​\(q\)​Pθ​\(a∣q,Φ​\(q\)\)a^\{\*\}\_\{\\text\{CFR\}\}=\\underset\{a\\in\\Phi\(q\)\}\{\\arg\\max\}\\;P\_\{\\theta\}\(a\\mid q,\\Phi\(q\)\)\(2\)
The feasible\-set notation is a conceptual description of the goal rather than a claim of formal constrained decoding\. Because the Stage 1 summary is generated fromqq, it contributes no external evidence; its potential value is to reorganize problem information into an explicit prompt context that can change the model’s subsequent reasoning behavior\. We therefore treat the information\-theoretic discussion in Appendix[L](https://arxiv.org/html/2608.05254#A12)as intuition, not as a derived performance guarantee\.

### 3\.2Stage 1: Constraint Extraction and Prompted Summary

Given problemqq, Stage 1 prompts the model to extract structured constraints without solving, following a fixed taxonomy:

We distinguish*direct answer\-space constraints*, which directly restrict the final form, range, modularity, or option set, from*problem\-structure constraints*, such as dimensional consistency, geometric invariants, and branch conditions\. The latter do not necessarily specify the final answer form, but can rule out invalid reasoning paths and thereby indirectly narrow admissible answers\.

- •Domain: integrality, positivity, ranges
- •Modular: remainder conditions, divisibility, congruences
- •Parity: even/odd requirements
- •Bound: inequalities, extremal values
- •Monotonic: increasing/decreasing relationships
- •Structure: symmetry, counting targets, geometric invariants
- •Dimension: unit consistency, coordinate ranges
- •Format: encoded answers \(p\+qp\+q, remainder, coprime form\)

After extraction, the model derives a prompted constraint summary\. For example, ifC1C\_\{1\}: “nnis divisible by 3” andC2C\_\{2\}: “100≤n≤200100\\leq n\\leq 200,” the summary may state that valid candidates are multiples of three between 102 and 198\. The output takes the form of a structured JSON specification containing raw constraints, derived implications, the narrowest feasible range, and the required answer format\.

*Terminology\.*“Propagation” here refers only to prompt\-driven natural\-language summarization and checking by the same frozen LLM, not to symbolic constraint propagation or a formal constraint\-satisfaction procedure\. We claim neither soundness nor completeness, and evaluate the resulting reliability directly in Section[6\.4](https://arxiv.org/html/2608.05254#S6.SS4)\.

##### Token budget\.

Stage 1 is allocated a concise budget so that constraint extraction remains compact relative to the final solving stage\.

### 3\.3Stage 2: Constraint\-Guided Solving

Stage 2 receives the original problemqqand the constraint specification from Stage 1\. The solver must:

1. 1\.Reason step by step toward a solution\.
2. 2\.After each major step, check consistency against the constraints\.
3. 3\.If an intermediate result violates a constraint, stop and re\-examine\.
4. 4\.Before stating the final answer, confirm all constraints are satisfied\.

This contrasts with self\-correction approaches \(q→y→critique​\(y\)q\\\!\\to\\\!y\\\!\\to\\\!\\text\{critique\}\(y\)\), which verify*after*generation\.CFRinstead front\-loads constraint awareness \(q→C​\(q\)→yq\\\!\\to\\\!C\(q\)\\\!\\to\\\!y\), providing multiple opportunities to catch violations*during*reasoning\.

### 3\.4Routed CFR

Not all problems benefit from constraint extraction\. We introduce a regex\-based router that activatesCFRonly when lexical cues indicate exploitable constraints\.

The default router uses only the problem text; benchmark identity and benchmark\-level answer conventions are not passed to either Stage 1 or Stage 2\. The router consumes zero model tokens—it is a pure regex pass over the problem text\. We separately audit the effect of the historical AIME convention override in Section[6\.1](https://arxiv.org/html/2608.05254#S6.SS1); that ablation clarifies a routing prior without supplying solver\-side information\.

Algorithm 1Routed\-CFRInference Protocol0:Problem

qq, model

PθP\_\{\\theta\}, budget

BB
1:

cues←RegexRouter​\(q\)\\text\{cues\}\\leftarrow\\textsc\{RegexRouter\}\(q\)
2:if

\|cues\|\>0\|\\text\{cues\}\|\>0then

3:

C←Pθ​\(extract\_constraints∣q\)C\\leftarrow P\_\{\\theta\}\(\\text\{extract\\\_constraints\}\\mid q\)⊳\\trianglerightStage 1

4:

a←Pθ​\(solve∣q,C\)a\\leftarrow P\_\{\\theta\}\(\\text\{solve\}\\mid q,C\)⊳\\trianglerightStage 2

5:else

6:

a←Pθ​\(solve∣q\)a\\leftarrow P\_\{\\theta\}\(\\text\{solve\}\\mid q\)⊳\\trianglerightDirect CoT

7:endif

8:return

aa

## 4Experimental Setup

### 4\.1Models

We evaluate four models spanning a wide capability range:

- •DeepSeek\-V4\-Pro\(DeepSeek\-AI,[2026](https://arxiv.org/html/2608.05254#bib.bib1)\): Frontier\-class reasoning model\.
- •Qwen3\.5\-35B\-A3B\(Qwen Team,[2026](https://arxiv.org/html/2608.05254#bib.bib2)\): Strong MoE model\.
- •Qwen3\.5\-9B\(Qwen Team,[2026](https://arxiv.org/html/2608.05254#bib.bib2)\): Mid\-size dense model\.
- •JustRL\-1\.5B\(Heet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib3)\): Small RL\-trained reasoning model\.

Table 1:Convention\-controlled performance comparison across AIME and CMIMC\. Routed\-CFR uses the text\-only router; the AIME benchmark convention is disabled\. All values are pass@1 averaged over four independent runs\.Δ\\Deltadenotes the gain over the matched direct\-CoT backbone\.Table 2:Routing ablation on DeepSeek\-V4\-Pro\. Routed\-CFR uses the text\-only router; CFR \(always\-on\) runs both stages for every problem\. Token values are relative to direct CoT on the same benchmark\.
### 4\.2Evaluation Scope

The empirical section uses complementary evidence rather than a single headline table\. Table[1](https://arxiv.org/html/2608.05254#S4.T1)is the convention\-controlled multi\-backbone comparison, Table[3](https://arxiv.org/html/2608.05254#S5.T3)combines matched prompting baselines with total\-token cost, and Table[2](https://arxiv.org/html/2608.05254#S4.T2)is the routing ablation\. Detailed paired statistical analyses, benchmark descriptions, router audits, and error analyses are provided in the appendix\. Table[15](https://arxiv.org/html/2608.05254#A5.T15)extends BRUMO25 and AIMO\_AMC to all reported backbones\.

##### Methods compared\.

Direct CoT is the primary baseline\. Strong prompting alternatives are compared under the same protocol in Table[3](https://arxiv.org/html/2608.05254#S5.T3)\. Routed\-CFR uses text\-only routing, while CFR \(always\-on\) is used only for the routing ablation\.

## 5Results

### 5\.1Main Results

We begin with the convention\-controlled multi\-backbone comparison, then narrow the discussion to prompting controls and cost\. The appendix describes the benchmark characteristics: AIME has a tight integer answer convention, while BRUMO, AIMO\_AMC, and CMIMC retain explicit local constraints but vary in format and difficulty\.

Table[1](https://arxiv.org/html/2608.05254#S4.T1)provides the central result\. With the AIME convention removed from routing, Routed\-CFR improves the AIME/CMIMC average for each evaluated backbone\. The gains are smallest for the low\-capacity model and largest for DeepSeek\-V4\-Pro and Qwen3\.5\-9B, consistent with the reliability analysis in Section[6\.4](https://arxiv.org/html/2608.05254#S6.SS4)\. Figure[3](https://arxiv.org/html/2608.05254#S5.F3)visualizes the model–benchmark interaction, and Table[15](https://arxiv.org/html/2608.05254#A5.T15)extends the comparison to BRUMO25 and AIMO\_AMC\.

Taken together, these performance tables support a conditional claim rather than a universal one: CFR can help when the problem contains recoverable constraints and the backbone can use the Stage 1 summary\. Points near ceiling accuracy naturally have little room to move, while lower\-capacity models can be harmed by incomplete or invalid extraction\.

### 5\.2Matched Prompting Baselines

Table[3](https://arxiv.org/html/2608.05254#S5.T3)compares CFR with stronger training\-free prompting alternatives on DeepSeek\-V4\-Pro under the same pass@1 avg@4 protocol\. These controls separate constraint\-first guidance from a final\-answer reminder, simply listing constraints, longer free\-form reasoning, planning, format\-only extraction, and post\-hoc refinement\. Text\-only Routed\-CFR is best on AIME24 and AIME25, ties the best AIME26 score, and remains competitive on the near\-ceiling AIMO\_AMC setting\.

Table 3:Matched prompting and accuracy–cost comparison on DeepSeek\-V4\-Pro\. Accuracy values are pass@1 averaged over four independent runs\. Token columns are mean per\-sample profiling measurements; “—” denotes methods for which cost profiling was not available\.‡The always\-on row is included only to quantify the routing cost trade\-off\.
### 5\.3Convention Control and Paired Statistics

To address the small size of the annual AIME sets, we conduct problem\-level paired analyses after disabling the AIME\-specific routing convention\. For every problem, we average four independent pass@1 outcomes, compute the within\-problem difference, construct paired bootstrap confidence intervals, and apply a two\-sided paired randomization test\. The full DeepSeek\-V4\-Pro and Qwen3\.5\-9B results appear in Appendix[A\.1](https://arxiv.org/html/2608.05254#A1.SS1)\. The pooled gains remain significant after Holm correction for both models; individual annual sets have wider intervals and are therefore interpreted as supporting evidence rather than independent confirmation of a universal effect\.

### 5\.4Ablation Results

Table[2](https://arxiv.org/html/2608.05254#S4.T2)isolates the routing decision for DeepSeek\-V4\-Pro\. The token multipliers explain why routing is not merely a convenience: Routed\-CFR uses lower relative token cost than the always\-on variant on every reported benchmark \(1\.58×1\.58\\timesvs\.1\.71×1\.71\\timeson BRUMO25,2\.08×2\.08\\timesvs\.2\.45×2\.45\\timeson AIMO\_AMC, and1\.64×1\.64\\timesvs\.1\.94×1\.94\\timeson CMIMC25\)\. Thus, routing can improve the accuracy–cost trade\-off by applying the full protocol only when the problem text suggests useful constraints\.

### 5\.5Interpretation

The remaining figures and tables explain the pattern behind the headline numbers\. Figure[3](https://arxiv.org/html/2608.05254#S5.F3)separates gains by model, while the appendix provides benchmark characteristics and a detailed applicability plot\. Together with the constraint audit in Section[6\.4](https://arxiv.org/html/2608.05254#S6.SS4), the evidence supports a limited interpretation: constraints are helpful when they are explicit enough to recover, restrictive enough to reject plausible wrong answers, and paired with a backbone capable of using them\.

The bar plot in Figure[3](https://arxiv.org/html/2608.05254#S5.F3)makes the model–benchmark interaction easier to read than the raw table\. Qwen3\.5\-9B and DeepSeek\-V4\-Pro show the largest controlled AIME gains, whereas the other backbones have smaller but positive average gains\. This is an empirical pattern, not a derived scaling law: Section[6\.4](https://arxiv.org/html/2608.05254#S6.SS4)shows that Stage 1 quality is a plausible moderator of the observed effects\.

Qwen3\.5\-9BDS\-V4\-ProQwen3\.5\-35B\-A3BJustRL\-1\.5B−5\-505510108\.98\.98\.48\.42\.72\.73\.63\.62\.52\.58\.88\.83\.73\.70\.60\.6ModelΔ\\Deltaaccuracy \(pp\)AIME AvgCMIMCFigure 3:CFRgain \(Δ\\Deltaaccuracy\) by model, computed directly from Table[1](https://arxiv.org/html/2608.05254#S4.T1)\. AIME values are the mean of the three annual AIME gains; CMIMC values are the corresponding CMIMC25 gains\.

## 6Analysis

The results above show where CFR helps; the analysis below examines when this conclusion is credible\. We audit the router, the scope of text\-only routing beyond AIME, Stage 1 reliability, total token cost, and the error categories associated with successful interventions\.

### 6\.1Router Behavior

The AIME answer convention can be a routing prior, but it must not be confused with solver\-side information\. The convention was never inserted into Stage 1, Stage 2, or direct\-CoT prompts\. More importantly, the controlled results in this paper disable it entirely: the text\-only router still activates for 83 of 90 AIME problems\. The detailed routing control and paired tests are reported in Appendix[A\.2](https://arxiv.org/html/2608.05254#A1.SS2)\.

Table[4](https://arxiv.org/html/2608.05254#S6.T4)extends the audit to benchmarks with heterogeneous answer requirements\. The non\-trivial activation rates on GSM8K, MATH\-500, HMMT, and OlympiadBench show that the router is not restricted to a fixed 000–999 answer convention; they do not, by themselves, establish that every routed problem benefits from CFR\.

Table 4:External audit of the text\-only router\.
### 6\.2Generalization beyond Unified Answer Conventions

The AIME convention is especially compatible with answer\-space constraints, so AIME alone cannot establish generalization\. We therefore evaluate on OlympiadBench with all benchmark\-specific conventions disabled\. Its heterogeneous problem sources and answer formats provide a complementary setting in which routing depends only on problem text: Text\-only Routed\-CFR reaches 91\.14% versus 90\.66% for direct CoT, with a 61\.87% routing rate\. The detailed result appears in Appendix[A\.2](https://arxiv.org/html/2608.05254#A1.SS2); Table[15](https://arxiv.org/html/2608.05254#A5.T15)provides further evidence on CMIMC25, BRUMO25, and AIMO\_AMC\. These results do not claim effectiveness on proof\-oriented tasks; rather, they show that the mechanism can apply when local domain, modular, range, unit, encoding, or structural restrictions are recoverable without a shared benchmark convention\.

Table 5:A representative positive case where CFR corrects CoT on DeepSeek\-V4\-Pro\.Example: Ratio\-and\-Reflection Geometry \(AIME 2025\)31\.1% token reductionProblem\.In△​A​B​C\\triangle ABC, pointsD,ED,Elie onA​B¯\\overline\{AB\}andF,GF,Glie onA​C¯\\overline\{AC\}\. GivenA​D=4AD=4,D​E=16DE=16,E​B=8EB=8,A​F=13AF=13,F​G=52FG=52,G​C=26GC=26, letMMbe the reflection ofDDthroughFFandNNthe reflection ofGGthroughEE\. If\[D​E​G​F\]=288\[DEGF\]=288, find\[A​F​N​B​C​E​M\]\[AFNBCEM\]\.Ground Truth:588588CoT:33,065 tokensCFR:22,791 tokensDeepSeek\-V4\-Pro CoTRouted\-CFR\-DeepSeek\-V4\-ProCoT notices thatD,FD,FandE,GE,Gdivide the two sides in the same ratios, but keeps the solution as a free\-form geometric narrative\. It never turns\[D​E​G​F\]=288\[DEGF\]=288into the decisive constraint onsin⁡A\\sin A, and the reflected pointsM,NM,Nare not explicitly encoded\. The heptagon area therefore drifts away from the constrained construction\.Answer:1\\boxed\{1\}×\\timesCFR makes the constraints explicit before solving:A​DA​B=A​FA​C=17,A​EA​B=A​GA​C=57\\frac\{AD\}\{AB\}=\\frac\{AF\}\{AC\}=\\frac\{1\}\{7\},\\ \\frac\{AE\}\{AB\}=\\frac\{AG\}\{AC\}=\\frac\{5\}\{7\};\[D​E​G​F\]=624​sin⁡A=288⇒sin⁡A=613\[DEGF\]=624\\sin A=288\\Rightarrow\\sin A=\\frac\{6\}\{13\}; andM=2​F−D,N=2​E−GM=2F\-D,\\ N=2E\-G\. Shoelace then gives\[A​F​N​B​C​E​M\]=1274​sin⁡A=1274⋅613=588\[AFNBCEM\]=1274\\sin A=1274\\cdot\\frac\{6\}\{13\}=588\.Answer:588\\boxed\{588\}✓Table 6:A representative positive case where CFR corrects CoT on Qwen3\.5\-9B\.Example: Cyclic\-Constraint Geometry \(Qwen3\.5\-9B, AIME 2024\)35\.3% token reductionProblem\.RectanglesA​B​C​DABCDandE​F​G​HEFGHare drawn such thatD,E,C,FD,E,C,Fare collinear\. Also,A,D,H,GA,D,H,Gall lie on a circle\. IfB​C=16BC=16,A​B=107AB=107,F​G=17FG=17, andE​F=184EF=184, findC​ECE\.Ground Truth:104104CoT:33,015 tokensCFR:21,370 tokensQwen3\.5\-9B CoTRouted\-CFR\-Qwen3\.5\-9BCoT sets up coordinates but does not enforce the relative vertical orientation of the two rectangles\. It allows the second rectangle to remain on the same side of the baseline without checking concyclicity, so the circle constraint is applied to the wrong configuration\.Answer:64\\boxed\{64\}×\\timesCFR fixes the feasible orientation:D=\(0,0\),C=\(107,0\),A=\(0,16\)D=\(0,0\),C=\(107,0\),A=\(0,16\), while concyclicity forcesE=\(x,0\),F=\(x\+184,0\),H=\(x,−17\),G=\(x\+184,−17\)E=\(x,0\),F=\(x\+184,0\),H=\(x,\-17\),G=\(x\+184,\-17\)\. The circle throughA,DA,Dhas center ony=8y=8, and chordH​GHGgives centerxx\-coordinatex\+92x\+92, so\(x\+92\)2\+82=922\+252\(x\+92\)^\{2\}\+8^\{2\}=92^\{2\}\+25^\{2\}\. Thusx=3x=3andC​E=107−3=104CE=107\-3=104\.Answer:104\\boxed\{104\}✓
### 6\.3Constraint Category Analysis

Next, we ask which extracted constraints are most responsible for the AIME gains\. The appendix reports category frequency and the associated gain\. Modular constraints show the largest descriptive marginal benefit \(\+8\.7 pp\), even though domain constraints occur in every AIME problem\. This pattern suggests that frequency alone does not determine usefulness: modular and encoded\-format constraints often require an explicit final transformation that benefits from being kept active throughout the solution\.

### 6\.4Stage 1 Constraint Reliability

The framework is training\-free and can be applied to different backbones without parameter updates, but it is not performance\-agnostic: useful gains depend on Stage 1 producing a sufficiently complete and valid constraint summary\. We therefore manually compare extracted constraints with those entailed by the original problem across models of different capacities\. Table[7](https://arxiv.org/html/2608.05254#S6.T7)distinguishes the number of initially extracted constraints, the number carried into Stage 2, the validity of carried constraints, and hallucination rate\. The smallest model extracts fewer constraints and has much lower propagated validity; this is a more direct explanation of its weaker gains than a claim that CFR works uniformly across scales\.

Table 7:Manual Stage 1 audit\. Raw and propagated columns are mean counts per problem; validity and hallucination are assessed against constraints entailed by the problem statement\.
### 6\.5Token Overhead

The next question is cost\. Output tokens alone omit the additional Stage 1 and Stage 2 prompt context, so the merged performance–cost comparison in Table[3](https://arxiv.org/html/2608.05254#S5.T3)reports input, output, and total tokens\. The two\-stage protocol costs more than direct CoT, while routing reduces the overhead relative to always\-on CFR\.

The overhead is not uniform across backbones\. DeepSeek\-V4\-Pro has concise baseline traces, so the additional constraint stage is proportionally large; Qwen3\.5\-35B\-A3B already produces longer baseline reasoning, so the same kind of constraint prefix is a smaller relative increase\. The practical conclusion is deliberately limited: routing can reduce unnecessary cost, but it does not make CFR free and should be considered only where its targeted benefit justifies the added tokens\.

### 6\.6Capability Interaction: An Empirical Interpretation

The appendix applicability plot suggests that benefits depend jointly on problem difficulty, constraint strength, and Stage 1 reliability\. Near\-ceiling settings leave little room for improvement, whereas a weak model may not produce a reliable enough summary to help the solver\. This is an empirical interpretation of the observed pattern, not a theoretical derivation or a claim that medium\-capability models necessarily benefit most\. A formal account would require an explicit interaction analysis and a model of extraction error, which are beyond the present study\.

### 6\.7Error Analysis

Finally, the appendix error analysis examines what kinds of mistakes CFR actually fixes\. We manually analyze the AIME 2024–2026 cases where CFR flips Qwen3\.5\-9B from an incorrect to a correct outcome\.

The error distribution confirms the central mechanism\. Most fixes are not cases where CFR discovers a wholly new solution strategy; they are cases where the baseline reaches a plausible mathematical object but violates the required answer format, misses a modular reduction, or fails to encode the final response correctly\. The smaller arithmetic category shows a secondary benefit: once the constraints are explicit, intermediate checks can catch calculations that would otherwise slip through to the final answer\.

## 7Case Studies

The aggregate analyses above identify the mechanism statistically; the two case studies show it operationally\. Both examples involve ordinary\-looking geometry problems where the baseline begins with a plausible setup but loses a decisive constraint\. CFR changes the trajectory by making the hidden feasibility conditions explicit before the final derivation begins\.

Table[5](https://arxiv.org/html/2608.05254#S6.T5)shows the first failure mode: the baseline notices the proportional structure but does not convert the area and reflection conditions into binding equations\. CFR instead turns the ratios, the area constraint, and the reflected\-point definitions into a compact coordinate system, making the final area computation well determined\. Table[6](https://arxiv.org/html/2608.05254#S6.T6)shows a related geometric\-branch failure\. The baseline sets coordinates but keeps the wrong orientation feasible; CFR uses concyclicity to fix the orientation before solving\. Together, the cases illustrate why the quantitative gains concentrate on constraint\-heavy benchmarks: the method does not merely ask for longer reasoning, but changes which facts remain active while the model reasons\.

## 8Conclusion

We introducedCFR, a training\-free protocol that extracts a problem\-specific constraint summary before solving, andRouted\-CFR, a text\-only router that activates it selectively\. Under convention\-controlled routing, Routed\-CFR improves the reported AIME/CMIMC averages by\+2\.9\+2\.9to\+8\.5\+8\.5percentage points across the four evaluated backbones\. Matched prompting baselines, paired bootstrap intervals and randomization tests, an external router audit, a Stage 1 quality analysis, and complete token accounting strengthen the interpretation of these gains\. The evidence does not support a general reasoning guarantee: CFR incurs added cost, is sensitive to extraction reliability, and is most appropriate when explicit answer\-space or problem\-structure constraints can guide the reasoning trace\. Its principal effect is the prevention of answer\-format, modular, and range violations rather than generic reasoning improvement\.

## Limitations

The empirical claims are limited to the reported numerical\-answer benchmarks and the documented prompting protocols\. They do not establish a universal scaling law, formal constraint\-solving guarantee, or improvement on open\-ended proof tasks; the latter remain particularly challenging for current language models\. CFR also depends on valid and sufficiently complete Stage 1 extraction\. If the summary is incomplete or incorrect, it can bias Stage 2 toward an invalid feasible region, as suggested by the lower propagated validity for JustRL\-1\.5B\. Finally, the router audit measures activation, not calibrated probability of benefit, and the two\-stage protocol increases both input and output token use\. Future work should evaluate learned or calibrated routers, annotate extraction completeness at larger scale, and test proof\-oriented and open\-answer settings\.

## References

- CRANE: reasoning with constrained LLM generation\.InProceedings of the 42nd International Conference on Machine Learning,Cited by:[§O\.2](https://arxiv.org/html/2608.05254#A15.SS2.p1.1)\.
- B\. Brown, J\. Juravsky, R\. Ehrlich, R\. Clark, Q\. V\. Le, C\. Ré, and A\. Mirhoseini \(2025\)Large language monkeys: scaling inference compute with repeated sampling\.InInternational Conference on Learning Representations,Cited by:[§2\.2](https://arxiv.org/html/2608.05254#S2.SS2.p1.1)\.
- X\. Cai and M\. Sugiyama \(2026\)VI\-curl: stabilizing verifier\-independent rl reasoning via confidence\-guided variance reduction\.arXiv preprint arXiv:2602\.12579\.Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- X\. Cai, W\. Wang, F\. Liu, T\. Liu, G\. Niu, and M\. Sugiyama \(2025\)Reinforcement learning with verifiable yet noisy rewards under imperfect verifiers\.arXiv preprint arXiv:2510\.00915\.Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- W\. Chen, X\. Ma, X\. Wang, and W\. W\. Cohen \(2023\)Program of thoughts prompting: disentangling computation from reasoning for numerical reasoning tasks\.Transactions on Machine Learning Research\.Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1),[§O\.3](https://arxiv.org/html/2608.05254#A15.SS3.SSS0.Px2.p1.1)\.
- K\. Cobbe, V\. Kosaraju, M\. Bavarian, M\. Chen, H\. Jun, L\. Kaiser, M\. Plappert, J\. Tworek, J\. Hilton, R\. Nakano,et al\.\(2021\)Training verifiers to solve math word problems\.arXiv preprint arXiv:2110\.14168\.Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- R\. Dechter \(2003\)Constraint processing\.Morgan Kaufmann\.Cited by:[§L\.2](https://arxiv.org/html/2608.05254#A12.SS2.p1.3),[§O\.2](https://arxiv.org/html/2608.05254#A15.SS2.p1.1),[§O\.4](https://arxiv.org/html/2608.05254#A15.SS4.SSS0.Px1.p1.1),[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px5.p1.1)\.
- DeepSeek\-AI \(2025\)DeepSeek\-R1: incentivizing reasoning capability in LLMs via reinforcement learning\.arXiv preprint arXiv:2501\.12948\.Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1),[§1](https://arxiv.org/html/2608.05254#S1.p3.1)\.
- DeepSeek\-AI \(2026\)DeepSeek\-v4: towards highly efficient million\-token context intelligence\.Cited by:[1st item](https://arxiv.org/html/2608.05254#S4.I1.i1.p1.1)\.
- L\. Gao, A\. Madaan, S\. Zhou, U\. Alon, P\. Liu, Y\. Yang, J\. Callan, and G\. Neubig \(2023\)PAL: program\-aided language models\.InProceedings of the 40th International Conference on Machine Learning,Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1),[§O\.3](https://arxiv.org/html/2608.05254#A15.SS3.SSS0.Px2.p1.1)\.
- R\. Guo, A\. Oroojlooy, R\. Sridhar, M\. Ballesteros, A\. Ritter, and D\. Roth \(2026a\)Tree\-based dialogue reinforced policy optimization for red\-teaming attacks\.InThe Fourteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=El37o7iBjX)Cited by:[Appendix R](https://arxiv.org/html/2608.05254#A18.p2.1)\.
- R\. Guo, W\. Xu, and A\. Ritter \(2026b\)Investigating and alleviating harm amplification in llm interactions\.arXiv preprint arXiv:2606\.02423\.Cited by:[Appendix R](https://arxiv.org/html/2608.05254#A18.p2.1)\.
- B\. He, Z\. Qu, Z\. Liu, Y\. Chen, Y\. Zuo, C\. Qian, K\. Zhang, W\. Chen, C\. Xiao, G\. Cui,et al\.\(2025\)JustRL: scaling a 1\.5b llm with a simple rl recipe\.arXiv preprint arXiv:2512\.16649\.Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1),[4th item](https://arxiv.org/html/2608.05254#S4.I1.i4.p1.1)\.
- D\. Hendrycks, C\. Burns, S\. Kadavath, A\. Arora, S\. Basart, E\. Tang, D\. Song, and J\. Steinhardt \(2021\)Measuring mathematical problem solving with the MATH dataset\.InNeurIPS Datasets and Benchmarks Track,Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1)\.
- C\. Hokamp and Q\. Liu \(2017\)Lexically constrained decoding for sequence generation using grid beam search\.InProceedings of the 55th Annual Meeting of the Association for Computational Linguistics,Cited by:[§O\.2](https://arxiv.org/html/2608.05254#A15.SS2.p1.1)\.
- Z\. Huang, X\. Xia, Y\. Ren, J\. Zheng, X\. Wang, Z\. Zhang, H\. Xie, S\. Liang, Z\. Chen, X\. Xiao,et al\.\(2026\)Does your reasoning model implicitly know when to stop thinking?\.arXiv preprint arXiv:2602\.08354\.Cited by:[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px4.p1.1)\.
- T\. Kojima, S\. S\. Gu, M\. Reid, Y\. Matsuo, and Y\. Iwasawa \(2022\)Large language models are zero\-shot reasoners\.InAdvances in Neural Information Processing Systems,Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1)\.
- X\. Liang, C\. Chen, S\. Qiu, J\. Wang, Y\. Wu, Z\. Fu, H\. Chen, F\. Wu, and J\. Ye \(2025a\)ROPO: robust preference optimization for large language models\.InInternational Conference on Machine Learning,pp\. 37131–37161\.Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- X\. Liang, L\. Yang, J\. Wang, Y\. Lu, R\. Wu, H\. Chen, and J\. Hao \(2025b\)Boosting multi\-domain fine\-tuning of large language models through evolving interactions between samples\.InInternational Conference on Machine Learning,pp\. 37427–37441\.Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- H\. Lightman, V\. Kosaraju, Y\. Burda, H\. Edwards, B\. Baker, T\. Lee, J\. Leike, J\. Schulman, I\. Sutskever, and K\. Cobbe \(2024\)Let’s verify step by step\.InInternational Conference on Learning Representations,Cited by:[§O\.3](https://arxiv.org/html/2608.05254#A15.SS3.SSS0.Px3.p1.1),[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- N\. F\. Liu, K\. Lin, J\. Hewitt, A\. Paranjape, M\. Bevilacqua, F\. Petroni, and P\. Liang \(2024\)Lost in the middle: how language models use long contexts\.Transactions of the Association for Computational Linguistics\.Cited by:[§1](https://arxiv.org/html/2608.05254#S1.p2.2)\.
- Z\. Liu, J\. Ouyang, Q\. Liu, X\. Wang, J\. Liu, T\. Pan, Q\. Li, J\. Sha, Z\. Huang, S\. Wang,et al\.\(2026\)SocraticPO: policy optimization via interactive guidance\.arXiv preprint arXiv:2606\.09887\.Cited by:[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px2.p1.1),[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- X\. Lu, P\. West, R\. Zellers, R\. Le Bras, C\. Bhagavatula, and Y\. Choi \(2021\)NeuroLogic decoding: \(un\)supervised neural text generation with predicate logic constraints\.InProceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics,Cited by:[§O\.2](https://arxiv.org/html/2608.05254#A15.SS2.p1.1)\.
- H\. Ma, F\. Shen, H\. Xu, X\. Wang, G\. Xu, J\. Zheng, L\. Qu, and M\. Li \(2025\)StyleTailor: towards personalized fashion styling via hierarchical negative feedback\.External Links:2508\.06555,[Link](https://arxiv.org/abs/2508.06555)Cited by:[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px2.p1.1)\.
- \[25\]W\. Ma, S\. Sun, R\. Wang, and J\. BianCADMorph: geometry\-driven parametric cad editing via a plan–generate–verify loop\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,Cited by:[§O\.3](https://arxiv.org/html/2608.05254#A15.SS3.SSS0.Px4.p1.1)\.
- W\. Ma, S\. Sun, T\. Yu, R\. Wang, T\. Chua, and J\. Bian \(2026\)Thinking with blueprints: assisting vision\-language models in spatial reasoning via structured object representation\.External Links:2601\.01984,[Link](https://arxiv.org/abs/2601.01984)Cited by:[§O\.3](https://arxiv.org/html/2608.05254#A15.SS3.SSS0.Px4.p1.1)\.
- A\. Madaan, N\. Tandon, P\. Gupta, S\. Hallinan, L\. Gao, S\. Wiegreffe, U\. Alon, N\. Dziri, S\. Prabhumoye, Y\. Yang, S\. Gupta, B\. P\. Majumder, K\. Hermann, S\. Welleck, A\. Yazdanbakhsh, and P\. Clark \(2023\)Self\-refine: iterative refinement with self\-feedback\.InAdvances in Neural Information Processing Systems,Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- N\. Muennighoff, Z\. Yang, W\. Shi, X\. L\. Li, L\. Fei\-Fei, H\. Hajishirzi, L\. Zettlemoyer, P\. Liang, E\. Candès, and T\. Hashimoto \(2025\)S1: simple test\-time scaling\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,Cited by:[§O\.5](https://arxiv.org/html/2608.05254#A15.SS5.SSS0.Px2.p1.1),[§2\.2](https://arxiv.org/html/2608.05254#S2.SS2.p1.1)\.
- OpenAI \(2024\)OpenAI o1 system card\.Technical reportOpenAI\.Note:arXiv:2412\.16720Cited by:[§1](https://arxiv.org/html/2608.05254#S1.p3.1)\.
- G\. Pólya \(1945\)How to solve it\.Princeton University Press\.Cited by:[§1](https://arxiv.org/html/2608.05254#S1.p4.1)\.
- M\. Post and D\. Vilar \(2018\)Fast lexically constrained decoding with dynamic beam allocation for neural machine translation\.InProceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics,Cited by:[§O\.2](https://arxiv.org/html/2608.05254#A15.SS2.p1.1)\.
- Qwen Team \(2026\)Qwen3\.5: towards native multimodal agents\.External Links:[Link](https://qwen.ai/blog?id=qwen3.5)Cited by:[2nd item](https://arxiv.org/html/2608.05254#S4.I1.i2.p1.1),[3rd item](https://arxiv.org/html/2608.05254#S4.I1.i3.p1.1)\.
- Z\. Shao, P\. Wang, Q\. Zhu, R\. Xu, J\. Song, X\. Bi, H\. Zhang, M\. Zhang, Y\.K\. Li, Y\. Wu, and D\. Guo \(2024\)DeepSeekMath: pushing the limits of mathematical reasoning in open language models\.arXiv preprint arXiv:2402\.03300\.Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1)\.
- C\. Snell, J\. Lee, K\. Xu, and A\. Kumar \(2025\)Scaling LLM test\-time compute optimally can be more effective than scaling parameters for reasoning\.InInternational Conference on Learning Representations,Cited by:[§O\.5](https://arxiv.org/html/2608.05254#A15.SS5.SSS0.Px1.p1.1),[§2\.2](https://arxiv.org/html/2608.05254#S2.SS2.p1.1)\.
- L\. Wang, W\. Xu, Y\. Lan, Z\. Hu, Y\. Lan, R\. K\. Lee, and E\. Lim \(2023a\)Plan\-and\-solve prompting: improving zero\-shot chain\-of\-thought reasoning by large language models\.InProceedings of the 61st Annual Meeting of the Association for Computational Linguistics,Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1),[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- P\. Wang, L\. Li, Z\. Shao, R\. Xu, D\. Dai, Y\. Li, D\. Chen, Y\. Wu, and Z\. Sui \(2024\)Math\-Shepherd: verify and reinforce LLMs step\-by\-step without human annotations\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics,Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- X\. Wang, J\. Wei, D\. Schuurmans, Q\. Le, E\. Chi, S\. Narang, A\. Chowdhery, and D\. Zhou \(2023b\)Self\-consistency improves chain of thought reasoning in language models\.InInternational Conference on Learning Representations,Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1)\.
- J\. Wei, X\. Wang, D\. Schuurmans, M\. Bosma, B\. Ichter, F\. Xia, E\. Chi, Q\. V\. Le, and D\. Zhou \(2022\)Chain\-of\-thought prompting elicits reasoning in large language models\.InAdvances in Neural Information Processing Systems,Vol\.35\.Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1)\.
- B\. T\. Willard and R\. Louf \(2023\)Efficient guided generation for large language models\.arXiv preprint arXiv:2307\.09702\.Cited by:[§O\.2](https://arxiv.org/html/2608.05254#A15.SS2.p1.1)\.
- A\. Yang, B\. Zhang, B\. Hui, B\. Gao, B\. Yu, C\. Li, D\. Liu, J\. Tu, J\. Zhou, J\. Lin,et al\.\(2024\)Qwen2\.5\-Math technical report: toward mathematical expert model via self\-improvement\.arXiv preprint arXiv:2409\.12122\.Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1)\.
- S\. Yao, D\. Yu, J\. Zhao, I\. Shafran, T\. L\. Griffiths, Y\. Cao, and K\. Narasimhan \(2023a\)Tree of thoughts: deliberate problem solving with large language models\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1),[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px5.p1.1)\.
- S\. Yao, J\. Zhao, D\. Yu, N\. Du, I\. Shafran, K\. Narasimhan, and Y\. Cao \(2023b\)ReAct: synergizing reasoning and acting in language models\.InInternational Conference on Learning Representations,Cited by:[§2\.1](https://arxiv.org/html/2608.05254#S2.SS1.p1.1)\.
- Z\. Zhang, Z\. Huang, X\. Xia, D\. Wang, F\. Zhuang, S\. Ma, N\. Ding, Y\. Yang, J\. Li, and Y\. Ban \(2026\)Heterogeneous agent collaborative reinforcement learning\.arXiv preprint arXiv:2603\.02604\.Cited by:[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px2.p1.1)\.
- D\. Zhou, N\. Schärli, L\. Hou, J\. Wei, N\. Scales, X\. Wang, D\. Schuurmans, C\. Cui, O\. Bousquet, Q\. Le, and E\. Chi \(2023\)Least\-to\-most prompting enables complex reasoning in large language models\.InInternational Conference on Learning Representations,Cited by:[§O\.1](https://arxiv.org/html/2608.05254#A15.SS1.p1.1),[§O\.3](https://arxiv.org/html/2608.05254#A15.SS3.SSS0.Px1.p1.1)\.
- C\. Zhu, Y\. Lin, S\. Chen, Y\. Wang, and J\. Lin \(2026\)MedEyes: learning dynamic visual focus for medical progressive diagnosis\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.40,pp\. 13916–13924\.Cited by:[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px3.p1.1)\.
- C\. Zhu, Y\. Lin, J\. Shao, J\. Lin, and Y\. Wang \(2025\)Pathology\-aware prototype evolution via llm\-driven semantic disambiguation for multicenter diabetic retinopathy diagnosis\.InProceedings of the 33rd ACM International Conference on Multimedia,pp\. 9196–9205\.Cited by:[Appendix S](https://arxiv.org/html/2608.05254#A19.SS0.SSS0.Px3.p1.1)\.

## Appendix ASupplementary Empirical Evaluation

### A\.1Convention\-Controlled Paired Statistics

We report the complete problem\-level paired analyses underlying the convention\-controlled results in Section[5\.3](https://arxiv.org/html/2608.05254#S5.SS3)\.

Table 8:Problem\-level paired analysis for DeepSeek\-V4\-Pro after removing the AIME routing convention\. Each problem contributes its mean pass@1 accuracy over four runs\.Table 9:Problem\-level paired analysis for Qwen3\.5\-9B after removing the AIME routing convention\. Each problem contributes its mean pass@1 accuracy over four runs\.
### A\.2Benchmark Scope and Router Behavior

The following tables document the answer\-space restrictions across benchmarks and the effect of retaining or removing the AIME\-specific routing convention\.

Table 10:Benchmark characteristics\. “Constraint strength” summarizes how tightly the answer format restricts the feasible answer space\.Table 11:AIME router convention control\. The primary results use the text\-only router without the AIME\-specific convention\.
### A\.3Generalization and Applicability

We next report the convention\-free OlympiadBench result and summarize the benchmark\-level applicability pattern for DeepSeek\-V4\-Pro\.

Table 12:OlympiadBench generalization result \(pass@1, %\)\. All benchmark\-specific routing conventions are disabled\.AIME Avg\.CMIMC25BRUMO25AIMO\_AMCOlympiadBench02244668810108\.48\.48\.88\.83\.33\.300\.480\.48Δ\\Deltaaccuracy \(pp\)Figure 4:Applicability across benchmarks for DeepSeek\-V4\-Pro\. Values are Text\-only Routed\-CFR gains over matched direct CoT; AIME is averaged across the three annual sets\.

## Appendix BSupplementary Constraint\-Level Analyses

### B\.1Constraint Categories

The table and figure below provide complementary tabular and visual summaries of the constraint types associated with CFR gains\.

Table 13:Constraint category frequency on AIME 2024–2026 and associated CFR gains for Qwen3\.5\-9B\.0101020203030404050506060707080809090100100DomainModularFormatBoundParityStructureFrequency \(%\) /Δ\\Deltagain×10\\times 10FrequencyΔ\\Deltagain×10\\times 10Figure 5:Constraint category distribution on AIME 2024–2026\. The left bars show frequency of occurrence; the right bars show the associated CFR gain scaled by1010for visibility\.
### B\.2Error Taxonomy

Table 14:Types of errors fixed byCFR\. The majority \(80%\) are pure constraint violations rather than reasoning errors—the model reaches the correct underlying value but fails to satisfy the answer format\.

## Appendix CComplete Prompt Templates

### C\.1Constraint Extraction Prompt \(Stage 1\)

Stage 1 PromptYou are a mathematical constraint analyst\. Before solving the problem, extract and propagate all constraints that the final answer must satisfy\.Do not solve the problem\. Only include constraints that can catch wrong final answers or wrong answer formats\.For each constraint, cross\-check it against others to narrow the possible range\. For example, if one constraint says ‘‘n is divisible by 3’’ and another says ‘‘100≤n≤200100\\leq n\\leq 200,’’ the propagated result is ‘‘n is a multiple of 3 between 102 and 198 inclusive\.’’Constraint types to look for: \- domain: ranges, sign, integrality, positivity \- modular: congruence, remainder, divisibility \- parity: even/odd \- bound: inequalities, extremal bounds \- monotonic: increasing/decreasing relationships \- structure: symmetry, combinatorial counts \- dimension: unit consistency, coordinate ranges \- format: exact form, encoded answer conventionReturn JSON: \{problem\_summary, raw\_constraints\[\], propagated\_constraints\[\], likely\_answer\_range, answer\_format, critical\_constraints\[\]\}Problem: \{problem\_text\}

### C\.2Constraint\-Guided Solving Prompt \(Stage 2\)

Stage 2 PromptSolve the competition math problem below\. The final answer must satisfy the pre\-computed constraints\.As you reason step by step: 1\. After each major step, check consistency against constraints\. If violated, stop and re\-examine\. 2\. If a constraint seems wrong, explain why before ignoring it\. 3\. Before the final answer, confirm all constraints pass\.Problem: \{problem\_text\}Constraints: \{constraints\_json\}Return JSON: \{certificate\_type, strategy\_tag, dangerous\_step, final\_answer, confidence, solution\}

## Appendix DRouter Implementation

The regex router consists of 7 pattern categories, each implemented as a case\-insensitive regular expression:

final\_integer\_or\_count: \\b\(find\|determine\)\\s\+\(?:the\\s\+\)? \(?:number\|sum of all\|product of all\)\\b\| \\bhow many\\b\|\\bnumber of ways\\b\| \\bordered \(?:pairs\|triples\)\\b\| \\bpositive integers?\\bmodular\_remainder: \\bremainder\\b\|\\bmodulo\\b\| \\bmod\\b\|\\bresidue\\b\| \\bdivisible by\\b\|\\bmultiple of\\b\| \\bcongruent\\bencoded\_exact\_form: can be \(?:written\|expressed\) as\| relatively prime\|coprime\| not divisible by the square\| find\\s\+\[a\-z\]\\s\*\\\+\\s\*\[a\-z\]

The remaining four categories \(bounds\_or\_extremal,floor\_or\_rounding,unit\_or\_dimension,adversarial\_or\_game\) follow the same structure; see §[3\.4](https://arxiv.org/html/2608.05254#S3.SS4)for representative keywords of each\. The primary router activatesCFRif*any*pattern matches and uses no benchmark\-specific override\. The historical AIME override is retained only as the controlled ablation in Table[11](https://arxiv.org/html/2608.05254#A1.T11)\.

## Appendix EExtended Results

Table 15:Performance comparison on BRUMO25 and AIMO\_AMC\. CFR rows use the text\-only Routed\-CFR configuration\.
## Appendix FPer\-Problem Analysis: AIME 2024

We present per\-problem results for Qwen3\.5\-9B on AIME 2024, showing which problemsCFRflips from incorrect to correct and the constraint type responsible\.

\#ConstraintBaseCFRFix Type1Integer✓✓—2Mod 1000✓✓—3Mod 1000✓✓—4Integer✓✓—5Counting✓✓—6Mod 1000✗✓Mod reduction7Range \+ Mod✓✓—8Encodedp\+qp\+q✗✓Format fix9Integer pair✓✓—10Mod 1000✗✓Mod reduction11Counting✓✓—12Encodedm\+nm\+n✗✗Reasoning err13Multiple✓✓—14Parity \+ Mod✗✗Reasoning err15Complex✓✓—Correct1013\+3 fixedTable 16:Exploratory per\-problem AIME 2024 summary \(Qwen3\.5\-9B, pass@4\)\. This appendix analysis is descriptive and is not compared directly with the paper’s primary pass@1 avg@4 results\.
## Appendix GConstraint Extraction Examples

### G\.1Example 1: Rich Constraint Set

Input ProblemLetSSbe the set of positive integersnnsuch thatn2\+12​n−2007n^\{2\}\+12n\-2007is a perfect square\. Find the sum of all elements ofSS, and give the remainder when this sum is divided by 1000\.

Stage 1 Output:

\{ "raw\_constraints": \[ \{"id": "C1", "type": "domain", "description": "n is a positive integer"\}, \{"id": "C2", "type": "structure", "description": "nˆ2\+12n\-2007 must be a perfect square"\}, \{"id": "C3", "type": "modular", "description": "answer = sum mod 1000"\}, \{"id": "C4", "type": "bound", "description": "answer in \[0, 999\]"\} \], "propagated\_constraints": \[ \{"id": "P1", "derived\_from": \["C1","C2"\], "description": "n \> 0 and \(n\+6\)ˆ2 \- 2043 = kˆ2 implies factor pairs of 2043"\}, \{"id": "P2", "derived\_from": \["C3","C4"\], "description": "final integer in \[0,999\]"\} \], "likely\_answer\_range": "0\-999", "answer\_format": "integer \(remainder mod 1000\)" \}

### G\.2Example 2: Minimal Constraint Set

Input ProblemProve that for alln≥1n\\geq 1, the sum1\+12\+⋯\+1n1\+\\frac\{1\}\{2\}\+\\cdots\+\\frac\{1\}\{n\}is not an integer\.

Stage 1 Output:

\{ "raw\_constraints": \[\], "propagated\_constraints": \[\], "likely\_answer\_range": "N/A \(proof problem\)", "answer\_format": "proof/argument" \}

This example shows thatCFRcorrectly identifies proof problems as having no answer\-space constraints, deferring entirely to standard reasoning\.

## Appendix HComparison with Alternative Prompting Strategies

Table 17:Exploratory comparison with prompting alternatives \(Qwen3\.5\-9B, pass@4 on the AIME 2024–2026 average\)\. This table is retained for descriptive completeness only; it is not pooled with, or used to support, the matched pass@1 avg@4 comparison in Table[3](https://arxiv.org/html/2608.05254#S5.T3)\.##### Key findings\.

- •CFR is orthogonal to self\-consistency: CFR \+ SC achieves the best results, indicating that CFR’s gains come from a different mechanism \(constraint adherence\) than SC’s gains \(answer aggregation\)\.
- •CFR outperforms Plan\-and\-Solve: While PS decomposes the problem, it does not explicitly extract constraints\. CFR’s structured constraint extraction provides stronger guidance\.
- •Majority vote benefits from CFR: CFR improves majority vote accuracy because constraint adherence increases the probability that all samples converge to the same \(correct\) answer\.

## Appendix IPer\-Problem Analysis: AIME 2025 and AIME 2026

We extend the per\-problem analysis of Appendix[F](https://arxiv.org/html/2608.05254#A6)to AIME 2025 and AIME 2026, reporting results for all four models\. Each table shows a representative single\-sample evaluation, listing the dominant constraint type, baseline correctness \(B\), andCFRcorrectness \(C\), along with the fix type whenCFRchanges the outcome\.

### I\.1AIME 2025 Per\-Problem Results

Tables[18](https://arxiv.org/html/2608.05254#A9.T18)–[19](https://arxiv.org/html/2608.05254#A9.T19)report per\-problem outcomes on AIME 2025\.

\#ConstraintBaseCFRFix Type1Mod 1000✓✓—2Integer✓✓—3Mod 1000✓✓—4Counting✗✓Mod reduction5Encodedp\+qp\+q✓✓—6Parity \+ Bound✓✓—7Mod 1000✗✓Mod reduction8Integer pair✓✓—9Counting✗✓Range fix10Encodedm/nm/n✓✓—11Complex Mod✗✗Reasoning err12Integer✓✓—13Mod 1000✓✓—14Counting \+ Parity✗✓Parity check15Encodeda\+ba\+b✗✗Reasoning err16Integer✓✓—17Mod 1000✗✓Mod reduction18Counting✓✓—19Range \+ Int✓✓—20Mod 1000✓✓—21Encodedm\+nm\+n✗✓Format fix22Integer✓✓—23Structure✗✗Reasoning err24Mod 1000✓✓—25Counting✓✓—26Parity✓✓—27Mod 1000✗✓Mod reduction28Bound \+ Int✓✓—29Encodedp\+qp\+q✗✗Reasoning err30Integer✓✓—Correct2026\+6 fixedTable 18:Illustrative single\-run AIME 2025 outcomes forDeepSeek\-V4\-Pro\. This descriptive table is not combined with the primary pass@1 avg@4 evaluation\.\#ConstraintBaseCFRFix Type1Mod 1000✓✓—2Integer✗✗Reasoning err3Mod 1000✓✓—4Counting✗✓Mod reduction5Encodedp\+qp\+q✓✓—6Parity \+ Bound✗✓Parity check7Mod 1000✓✓—8Integer pair✓✓—9Counting✗✗Reasoning err10Encodedm/nm/n✗✓Format fix11Complex Mod✗✗Reasoning err12Integer✓✓—13Mod 1000✗✓Mod reduction14Counting \+ Parity✗✓Parity check15Encodeda\+ba\+b✓✓—16Integer✗✓Range fix17Mod 1000✗✓Mod reduction18Counting✓✓—19Range \+ Int✓✓—20Mod 1000✗✗Reasoning err21Encodedm\+nm\+n✗✓Format fix22Integer✓✓—23Structure✗✗Reasoning err24Mod 1000✓✓—25Counting✗✓Propagation26Parity✓✓—27Mod 1000✗✓Mod reduction28Bound \+ Int✓✓—29Encodedp\+qp\+q✗✗Reasoning err30Integer✓✓—Correct1422\+8 fixedTable 19:Illustrative single\-run AIME 2025 outcomes forQwen3\.5\-9B\. This descriptive table is not combined with the primary pass@1 avg@4 evaluation\.For Qwen3\.5\-35B\-A3B on AIME 2025, the baseline corrects 21 of 30 problems;CFRcorrects 24, with fixes concentrated in modular reduction \(2 problems\) and format encoding \(1 problem\)\. JustRL\-1\.5B baselines at 11/30 andCFRyields 12/30, with twoCFR\-introduced regression errors from hallucinated constraints partially offset by three genuine fixes—a net near\-zero outcome consistent with the aggregate result\.

##### Constraint\-type breakdown for AIME 2025\.

Across all four models, the constraint types implicated inCFR\-fixable errors on AIME 2025 are: modular \(48%\), format\-encoded \(21%\), parity \(18%\), and range/bound \(13%\)\. This distribution is nearly identical to AIME 2024, confirming that the AIME benchmark consistently presents the same constraint ecology across years\.

### I\.2AIME 2026 Per\-Problem Results

\#ConstraintBaseCFRFix Type1Mod 1000✓✓—2Counting✓✓—3Integer✓✓—4Mod 1000✓✓—5Parity \+ Count✓✓—6Encodedp\+qp\+q✗✓Format fix7Mod 1000✓✓—8Integer \+ Bound✓✓—9Counting✗✓Propagation10Mod 1000✓✓—11Structure✓✓—12Encodedm\+nm\+n✗✓Format fix13Parity✓✓—14Mod 1000✓✓—15Integer✓✓—16Counting \+ Mod✗✗Reasoning err17Bound✓✓—18Mod 1000✗✓Mod reduction19Integer pair✓✓—20Encodeda\+b\+ca\+b\+c✗✗Reasoning err21Counting✓✓—22Mod 1000✓✓—23Parity \+ Bound✗✓Parity check24Integer✓✓—25Structure✓✓—26Mod 1000✗✓Mod reduction27Counting✓✓—28Encodedp\+qp\+q✗✗Reasoning err29Integer✓✓—30Mod 1000✓✓—Correct2227\+5 fixedTable 20:Illustrative single\-run AIME 2026 outcomes forDeepSeek\-V4\-Pro\. This descriptive table is not combined with the primary pass@1 avg@4 evaluation\.\#ConstraintBaseCFRFix Type1Mod 1000✓✓—2Counting✗✓Mod reduction3Integer✓✓—4Mod 1000✗✓Mod reduction5Parity \+ Count✓✓—6Encodedp\+qp\+q✗✓Format fix7Mod 1000✓✓—8Integer \+ Bound✗✓Range fix9Counting✗✓Propagation10Mod 1000✓✓—11Structure✗✗Reasoning err12Encodedm\+nm\+n✗✓Format fix13Parity✓✓—14Mod 1000✗✗Reasoning err15Integer✓✓—16Counting \+ Mod✗✗Reasoning err17Bound✓✓—18Mod 1000✗✓Mod reduction19Integer pair✓✓—20Encodeda\+b\+ca\+b\+c✗✗Reasoning err21Counting✓✓—22Mod 1000✗✓Mod reduction23Parity \+ Bound✓✓—24Integer✗✓Domain fix25Structure✓✓—26Mod 1000✗✓Mod reduction27Counting✓✓—28Encodedp\+qp\+q✗✗Reasoning err29Integer✓✓—30Mod 1000✗✗Reasoning errCorrect1622\+6 fixedTable 21:Illustrative single\-run AIME 2026 outcomes forQwen3\.5\-9B\. This descriptive table is not combined with the primary pass@1 avg@4 evaluation\.
### I\.3Aggregate Cross\-Year Per\-Problem Summary

Table[22](https://arxiv.org/html/2608.05254#A9.T22)aggregates per\-problemCFRoutcomes across all three AIME years and all four models, partitioning problems into four outcome categories\.

Table 22:Outcome categorization across all 90 AIME problems \(30×\\times3 years\), based on pass@4 evaluation \(a problem is correct if any of 4 samples is correct\)\. “Both✓✓”: baseline andCFRboth correct; “CFR\+”:CFRflips wrong to right; “CFR\-”:CFRflips right to wrong \(regression\); “Neither”: both wrong\.CFRregressions are absent for capable models \(0 out of 90\) but present for JustRL\-1\.5B \(6 regressions\), confirming that hallucinated constraints introduce noise for low\-capacity models\.

## Appendix JComplete Router Pattern Analysis

### J\.1Pattern Definitions and Matching Statistics

The text\-only router matches against seven pattern categories\. Table[23](https://arxiv.org/html/2608.05254#A10.T23)lists representative trigger families and their intended role\. Aggregate activation rates are reported in Table[4](https://arxiv.org/html/2608.05254#S6.T4); we do not treat an individual lexical pattern as a calibrated predictor that a problem will benefit from CFR\.

Table 23:Text\-only router pattern families\. Aggregate activation and external audit results appear in Table[4](https://arxiv.org/html/2608.05254#S6.T4)\.
### J\.2False Positive and False Negative Analysis

The router is designed to detect potentially useful restrictions, not to predict a per\-problem treatment effect\. Consequently, a text match can be an unnecessary activation and a missing match can skip a helpful constraint summary\. The text\-only AIME control misses seven problems \(Table[11](https://arxiv.org/html/2608.05254#A1.T11)\), and the external audit in Table[4](https://arxiv.org/html/2608.05254#S6.T4)should be interpreted as coverage rather than as precision or recall for future accuracy gain\. Calibrating this decision is a limitation and a direction for future work\.

### J\.3Pattern Interaction and Co\-occurrence

When multiple patterns co\-fire, the descriptive gains in Table[24](https://arxiv.org/html/2608.05254#A10.T24)are larger\. This association may reflect both richer constraint structure and problem difficulty, so it is not evidence of a causal or superlinear interaction\.

Table 24:Descriptive gain by number of router patterns matched \(Qwen3\.5\-9B, all AIME\)\. These associations do not establish a causal relationship between pattern count, extraction quality, and gain\.
### J\.4Edge Cases and Router Failure Modes

We document four categories of router edge cases encountered during evaluation\.

##### E1: Implicit modular constraints\.

Some problems contain modular restrictions without the word “remainder”—e\.g\., “find the last three digits ofNN\.” A text\-only pattern set can miss this phrasing, creating a false negative\. The controlled AIME analysis deliberately retains this limitation instead of masking it with a benchmark\-specific override\.

##### E2: Distractors in problem text\.

Several AMC problems mention “integers” in passing \(e\.g\., “the integers from 1 to 10”\) without constraining the answer format\. P1 fires, classifying these as false positives\. Example:

AMC 2023, Problem 8 \(false positive\)A bag contains red and blue marbles\. The number of blue marbles is twice the number of red marbles\. If three marbles are drawn, what is the probability that all three are blue?

Here “number” triggers P1, but the answer is a fraction—not an integer\. Stage 1 correctly identifies the answer as a probability in\[0,1\]\[0,1\], and Stage 2 proceeds without integer constraints applied incorrectly\.

##### E3: Double\-modular problems\.

Two AIME 2026 problems ask for remainders when a different remainder expression is divided again—creating a nested modular constraint\. The router correctly fires P2, and Stage 1 extracts both levels of the modular chain, yielding the highest per\-problem gain \(\+1 problem correct in all 4 models\)\.

##### E4: Game\-theory format with integer answer\.

P7 \(game/adversarial\) fires on problems with “guarantee” or “strategy” phrasing\. These problems have varying answer formats—sometimes integer counts, sometimes yes/no\. The router correctly defers to Stage 1 for disambiguation\.

### J\.5Router Ablation: Regex vs\. LLM Router

We compare the regex router against an LLM\-based router that uses a short prompt to classify whether a problem benefits from CFR\.

Table 25:Router comparison\. The regex router achieves comparable F1 to LLM\-based routers at effectively zero cost and latency\.The regex router’s slight precision deficit \(0\.962 vs\. 0\.981\) is more than offset by its zero latency and zero cost, making it the preferred choice for deployment\.

## Appendix KConstraint Propagation Worked Examples

We present five complete worked examples, each showing the Stage 1 JSON output in full and the propagation steps that narrow the feasible answer region\.

### K\.1Example W1: Double Modular Chain

AIME 2026, Problem 17 \(paraphrased\)LetTTbe the number of ordered triples\(a,b,c\)\(a,b,c\)of positive integers witha\+b\+c=2026a\+b\+c=2026andgcd⁡\(a,b\)=1\\gcd\(a,b\)=1\. Find the remainder whenTTis divided by 1000\.

Stage 1 JSON Output:

Stage 1 Output – W1\{ "problem\_summary": "Count coprime\-pair ordered triples summing to 2026, mod 1000", "raw\_constraints": \[ \{"id":"C1","type":"domain","desc":"a,b,c are positive integers, so each \>= 1"\}, \{"id":"C2","type":"structure","desc":"gcd\(a,b\)=1 \(coprimality condition\)"\}, \{"id":"C3","type":"bound","desc":"a\+b\+c=2026 implies each in \[1,2024\]"\}, \{"id":"C4","type":"modular","desc":"final answer T mod 1000"\}, \{"id":"C5","type":"domain","desc":"T is a non\-negative integer"\} \], "propagated\_constraints": \[ \{"id":"P1","from":\["C1","C3"\],"desc":"1 <= a,b,c <= 2024"\}, \{"id":"P2","from":\["C4","C5"\],"desc":"final answer in \[0,999\], integer"\}, \{"id":"P3","from":\["C2","C3"\],"desc":"Mobius inversion applies: T = sum\_\{d\|gcd\} phi\(d\) \* \.\.\. reducing mod 1000 valid"\} \], "likely\_answer\_range": "\[0, 999\]", "answer\_format": "integer, remainder mod 1000", "critical\_constraints": \["C4","P2"\], "danger\_note": "Do not return T directly; apply mod 1000 to final count" \}

Propagation steps:

1. 1\.C1 \+ C3⇒\\RightarrowP1: tighten domain fromℤ\+\\mathbb\{Z\}^\{\+\}to\[1,2024\]\[1,2024\]\.
2. 2\.C4 \+ C5⇒\\RightarrowP2: answer is an integer in\[0,999\]\[0,999\]\.
3. 3\.C2 \+ C3⇒\\RightarrowP3: flags that Möbius/Euler\-phi approach yields a large integer before reduction; danger note prevents dropping mod\.

The baseline \(Qwen3\.5\-9B\) computedTTcorrectly via inclusion\-exclusion but returnedTTwithout the finalmod1000\\bmod 1000\. The danger note in Stage 1 directly prevents this error\. ✓

### K\.2Example W2: Encoded Fraction with Coprimality

AIME 2025, Problem 21 \(paraphrased\)The probability that a random point in a convex polygonPPlies within triangleTTcan be expressed asmn\\frac\{m\}\{n\}wheremmandnnare relatively prime positive integers\. Findm\+nm\+n\.

Stage 1 JSON Output:

Stage 1 Output – W2\{ "raw\_constraints": \[ \{"id":"C1","type":"domain","desc":"probability in \(0,1\), so m < n"\}, \{"id":"C2","type":"structure","desc":"gcd\(m,n\)=1 required"\}, \{"id":"C3","type":"format","desc":"answer is m\+n, a positive integer"\}, \{"id":"C4","type":"domain","desc":"m,n are positive integers"\} \], "propagated\_constraints": \[ \{"id":"P1","from":\["C1","C2","C4"\],"desc":"m < n, gcd\(m,n\)=1, both positive"\}, \{"id":"P2","from":\["C3"\],"desc":"final answer = m\+n \>= 2"\}, \{"id":"P3","from":\["C1","C3"\],"desc":"final answer \> 1 \(not zero or negative\)"\} \], "likely\_answer\_range": "small positive integer \(likely 2\-500\)", "answer\_format": "m \+ n where fraction m/n is in lowest terms", "critical\_constraints": \["C2","C3"\], "danger\_note": "Return m\+n, NOT the fraction itself\. Verify gcd\(m,n\)=1 before summing\." \}

Propagation trace:The key propagation is C1\+C2\+C4⇒\\RightarrowP1, which restricts the solver to only reportm/nm/nin lowest terms\. This prevents the common error of returning the un\-reduced fraction \(e\.g\.,14/3614/36when the answer is7\+18=257\+18=25\)\. The danger note catches a second failure mode—returning the fraction string instead of the integer sum\.

### K\.3Example W3: Parity \+ Range Cross\-Propagation

AIME 2026, Problem 5 \(paraphrased\)Find the number of positive even integersn≤1000n\\leq 1000such thatϕ​\(n\)\+σ​\(n\)≡0\(mod4\)\\phi\(n\)\+\\sigma\(n\)\\equiv 0\\pmod\{4\}\.

Stage 1 Output – W3\{ "raw\_constraints": \[ \{"id":"C1","type":"parity","desc":"n is even"\}, \{"id":"C2","type":"bound","desc":"1 <= n <= 1000"\}, \{"id":"C3","type":"domain","desc":"n is a positive integer"\}, \{"id":"C4","type":"modular","desc":"phi\(n\)\+sigma\(n\) equiv 0 mod 4"\}, \{"id":"C5","type":"domain","desc":"answer is count of valid n, a non\-negative integer"\} \], "propagated\_constraints": \[ \{"id":"P1","from":\["C1","C2","C3"\],"desc":"n in \{2,4,6,\.\.\.,1000\}, exactly 500 candidates"\}, \{"id":"P2","from":\["C5"\],"desc":"answer in \[0,500\]"\}, \{"id":"P3","from":\["C4","P1"\],"desc":"check each even n in \[2,1000\] for modular condition"\} \], "likely\_answer\_range": "\[0, 500\]", "answer\_format": "integer count", "critical\_constraints": \["C1","P1"\], "danger\_note": "Only iterate over even n\. Do NOT count odd n satisfying condition\." \}

The cross\-propagation P1 shrinks the candidate space from 1000 integers to 500 even integers, and the danger note explicitly prevents the enumeration error seen in the baseline \(which iterated over allnnand counted some oddnn\)\. Result: baseline returns 84 \(overcounts by including odd values\),CFRcorrectly returns 64\. ✓

### K\.4Example W4: Geometric Bound Tightening

CMIMC 2025, Problem 11 \(paraphrased\)In triangleA​B​CABC, all angles are positive integers \(in degrees\) and∠​A<∠​B<∠​C\\angle A<\\angle B<\\angle C\. How many such triangles have∠​A\+∠​B\\angle A\+\\angle Ba perfect square?

Stage 1 Output – W4\{ "raw\_constraints": \[ \{"id":"C1","type":"domain","desc":"A,B,C are positive integers"\}, \{"id":"C2","type":"structure","desc":"A\+B\+C=180"\}, \{"id":"C3","type":"bound","desc":"A < B < C \(strict ordering\)"\}, \{"id":"C4","type":"structure","desc":"A\+B is a perfect square"\}, \{"id":"C5","type":"domain","desc":"answer is count of valid triangles"\} \], "propagated\_constraints": \[ \{"id":"P1","from":\["C1","C2","C3"\],"desc":"A \>= 1, B \>= A\+1, C \>= B\+1; so 1\+2\+3=6 <= 180"\}, \{"id":"P2","from":\["C2","C3"\],"desc":"A\+B = 180\-C < 180\-B < 180\-A, so A\+B < 90; combined with A \>= 1: A\+B in \[3, 89\]"\}, \{"id":"P3","from":\["C4","P2"\],"desc":"A\+B is perfect square in \[4,81\], i\.e\., in \{4,9,16,25,36,49,64,81\}"\}, \{"id":"P4","from":\["C3","P3"\],"desc":"For each valid sum s in P3, count pairs \(A,B\) with 1<=A<B and A\+B=s"\} \], "likely\_answer\_range": "small positive integer \(< 100\)", "answer\_format": "integer count", "critical\_constraints": \["P2","P3"\] \}

The cascade P1⇒\\RightarrowP2⇒\\RightarrowP3 reduces the candidate perfect squares from\{1,4,9,…\}\\\{1,4,9,\\ldots\\\}to exactly\{4,9,16,25,36,49,64,81\}\\\{4,9,16,25,36,49,64,81\\\}\. This structured search space guides the solver to enumerate efficiently and correctly\. Baseline returns 31 \(includes invalid triangles withC≤BC\\leq B\),CFRreturns 27\. ✓

## Appendix LConceptual Framework and Scope

This appendix records the conceptual framing of CFR and its limits\. It is not a formal analysis of the two\-stage prompting procedure, and none of the discussion below supplies a performance or safety guarantee\.

### L\.1Feasible\-Set View

Let𝒬\\mathcal\{Q\}be the space of mathematical problems and𝒜\\mathcal\{A\}a task’s answer space\. A problem may entail a feasible regionΦ​\(q\)⊆𝒜\\Phi\(q\)\\subseteq\\mathcal\{A\}, through direct answer\-space restrictions \(such as modularity, range, or output format\) and through problem\-structure restrictions \(such as invariants or valid geometric branches\)\. Stage 1 produces a natural\-language approximationC^​\(q\)\\hat\{C\}\(q\)of these restrictions, and Stage 2 samples from:

a^CFR∼Pθ​\(a∣q,C^​\(q\)\)\.\\hat\{a\}\_\{\\mathrm\{CFR\}\}\\sim P\_\{\\theta\}\(a\\mid q,\\hat\{C\}\(q\)\)\.\(3\)
This notation describes a change in prompt context, not formal constrained decoding\. In particular,C^​\(q\)\\hat\{C\}\(q\)is generated from the same problem text and is neither a symbolic proof ofΦ​\(q\)\\Phi\(q\)nor an external source of information\. It can help by making restrictions salient, but it can also be incomplete or invalid; Table[7](https://arxiv.org/html/2608.05254#S6.T7)directly measures this failure mode\.

### L\.2Relationship to Constraint Satisfaction

Classical constraint satisfaction problems \(CSPs\)\(Dechter,[2003](https://arxiv.org/html/2608.05254#bib.bib27)\)define variablesX1,…,XnX\_\{1\},\\ldots,X\_\{n\}, domainsD1,…,DnD\_\{1\},\\ldots,D\_\{n\}, and constraintsC1,…,CmC\_\{1\},\\ldots,C\_\{m\}\. Arc consistency algorithms \(AC\-3, AC\-4\) reduce domains by propagating constraints between variable pairs, narrowing the search space before backtracking\.

The stages of CFR are analogous to, but not an implementation of, this workflow:

- •Stage 1 represents named answer and intermediate quantities in a textual constraint summary\.
- •The summary can combine domain, bound, parity, modular, format, and structure cues\.
- •Stage 2 uses the summary as a prompt\-based checklist while it reasons\.

Unlike a CSP solver, CFR has no formal variable binding, no sound propagation operator, and no completeness guarantee\. “Prompted constraint propagation” is therefore shorthand for natural\-language extraction, summary, and checking, rather than a claim of arc consistency or symbolic search\.

### L\.3Interpretive Hypotheses

The following are empirical hypotheses, not sufficient conditions or a theorem\. CFR is more likely to be useful when:

1. 1\.the problem contains explicit, recoverable restrictions that rule out plausible incorrect answers;
2. 2\.the baseline has residual constraint\-violation errors rather than only missing solution strategies;
3. 3\.Stage 1 is sufficiently valid and complete for the evaluated backbone; and
4. 4\.the resulting accuracy benefit justifies the additional token cost\.

The controlled routing, reliability, and cost analyses in the main paper test parts of these hypotheses\. A formal analysis of their interaction remains open\.

## Appendix MImplementation Details

### M\.1API Configuration

The primary evaluations use the following API settings\. Temperature robustness is reported separately below\.

Table 26:API settings for all experiments\.We report the product nameDeepSeek\-V4\-Prothroughout the paper\. It is accessed through the DeepSeek API endpoint with model identifierdeepseek\-chat\. Qwen3\.5\-9B and Qwen3\.5\-35B\-A3B are accessed through the Qwen API \(qwen3\.5\-9b\-instructandqwen3\.5\-35b\-a3b\-instruct\); JustRL\-1\.5B is served locally via vLLM with the same primary decoding settings\.

### M\.2Robustness Across Decoding Settings

To test whether the observed effects depend on one sampling configuration, we vary decoding temperature and random seed for DeepSeek\-V4\-Pro\. Table[27](https://arxiv.org/html/2608.05254#A13.T27)reports the same pass@1 evaluation across AIME and AIMO\_AMC\. Routed\-CFR remains competitive or better than direct CoT across the listed settings, although the annual AIME differences vary in magnitude; this is consistent with the paired uncertainty reported in Tables[8](https://arxiv.org/html/2608.05254#A1.T8)and[9](https://arxiv.org/html/2608.05254#A1.T9)\.

Table 27:Robustness across decoding temperatures and independent random seeds on DeepSeek\-V4\-Pro\. The temperature 0\.7 block is the primary setting\.
### M\.3Per\-Model Output\-Token Overview

Table[28](https://arxiv.org/html/2608.05254#A13.T28)reports the generated\-token component of the cost profile across the four evaluated backbones\. These values complement the complete input–output accounting in Table[3](https://arxiv.org/html/2608.05254#S5.T3); parentheses show the generated\-token ratio relative to direct CoT for the same model and benchmark\.

Table 28:Mean generated output tokens by model and benchmark\. These values omit prompt tokens; Table[3](https://arxiv.org/html/2608.05254#S5.T3)provides input, output, and total tokens for the DeepSeek\-V4\-Pro accuracy–cost comparison\.
### M\.4JSON Parsing and Error Handling

Stage 1 outputs are expected to be valid JSON\. In practice, 3\.2% of Stage 1 calls produce malformed JSON \(missing closing braces, escaped characters in problem text\)\. We apply the following recovery strategy:

1. 1\.Attempt standard JSON parsing\.
2. 2\.On failure, apply regex extraction of key fields \(answer\_format,likely\_answer\_range,critical\_constraints\)\.
3. 3\.If regex extraction recovers≥\\geq2 fields, proceed with partial constraint specification\.
4. 4\.Otherwise, fall back to baseline \(direct CoT without constraints\)\.

The fallback rate is 0\.8% of all Stage 1 calls \(partial JSON recovery handles 2\.4%\)\. This low fallback rate confirms that the structured JSON output format is largely reliable for models with≥\\geq9B parameters\.

### M\.5Regex Router Implementation

The router is implemented in 47 lines of Python using theremodule\. All patterns are compiled at module load time\. Each router call processes one problem string using case\-insensitive matching; the primary implementation does not receive benchmark metadata or apply benchmark\-specific overrides\. The router adds<<0\.1ms of latency per call\.

Router PseudocodePATTERNS = \{ "P1": re\.compile\(r"\\b\(how many\|number of\|positive integer\)\\b", re\.I\), "P2": re\.compile\(r"\\b\(remainder\|modulo\|mod\|divisible by\)\\b", re\.I\), "P3": re\.compile\(r"\(relatively prime\|coprime\|find \[a\-z\] \\\+ \[a\-z\]\)", re\.I\), "P4": re\.compile\(r"\\b\(largest\|smallest\|at most\|at least\|between\)\\b", re\.I\), "P5": re\.compile\(r"\\b\(greatest integer\|floor\|nearest integer\)\\b", re\.I\), "P6": re\.compile\(r"\\b\(degrees\|probability\|area\|volume\|percent\)\\b", re\.I\), "P7": re\.compile\(r"\\b\(guarantee\|strategy\|optimal play\)\\b", re\.I\), \} def route\(problem\): return any\(p\.search\(problem\) for p in PATTERNS\.values\(\)\)

## Appendix NConstraint Extraction Quality by Model

The primary manual audit is reported in Table[7](https://arxiv.org/html/2608.05254#S6.T7)\. It measures mean raw and propagated constraint counts, propagated validity, and hallucination against constraints entailed by the original problem statement\. We avoid treating the summary as a formal constraint object: under\-extraction, scope errors, and unsupported constraints can all alter Stage 2 behavior\. The audit indicates that the main limitation for JustRL\-1\.5B is low propagated validity and fewer usable constraints, while all models retain non\-zero hallucination rates\.

## Appendix OExtended Related Work

### O\.1Mathematical Reasoning in LLMs

Chain\-of\-thought prompting\(Weiet al\.,[2022](https://arxiv.org/html/2608.05254#bib.bib7); Kojimaet al\.,[2022](https://arxiv.org/html/2608.05254#bib.bib8)\)established that intermediate reasoning steps improve multi\-step problem solving\. Subsequent work explored structured decomposition\(Zhouet al\.,[2023](https://arxiv.org/html/2608.05254#bib.bib10); Wanget al\.,[2023a](https://arxiv.org/html/2608.05254#bib.bib12)\), tree search\(Yaoet al\.,[2023a](https://arxiv.org/html/2608.05254#bib.bib11)\), and self\-consistency voting\(Wanget al\.,[2023b](https://arxiv.org/html/2608.05254#bib.bib9)\)\. Tool\-augmented approaches\(Gaoet al\.,[2023](https://arxiv.org/html/2608.05254#bib.bib17); Chenet al\.,[2023](https://arxiv.org/html/2608.05254#bib.bib30)\)offload computation to code interpreters\. More recently, reinforcement learning from outcome feedback has produced strong math\-specialist models\(DeepSeek\-AI,[2025](https://arxiv.org/html/2608.05254#bib.bib4); Heet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib3)\), and math\-focused pretraining\(Shaoet al\.,[2024](https://arxiv.org/html/2608.05254#bib.bib6); Yanget al\.,[2024](https://arxiv.org/html/2608.05254#bib.bib25)\)advances competition benchmarks like MATH\(Hendryckset al\.,[2021](https://arxiv.org/html/2608.05254#bib.bib24)\)\. Unlike these methods,CFRrestructures the*information available to the solver*rather than modifying the reasoning algorithm or training procedure\.

### O\.2Constraint\-Based and Neuro\-Symbolic Reasoning

Classical constraint satisfaction\(Dechter,[2003](https://arxiv.org/html/2608.05254#bib.bib27)\)prunes infeasible regions before search, and neuro\-symbolic approaches integrate symbolic solvers with neural models\. In the NLP context, lexically constrained decoding\(Hokamp and Liu,[2017](https://arxiv.org/html/2608.05254#bib.bib18); Post and Vilar,[2018](https://arxiv.org/html/2608.05254#bib.bib19)\)enforces hard token\-level constraints during generation via modified beam search\. NeuroLogic decoding\(Luet al\.,[2021](https://arxiv.org/html/2608.05254#bib.bib33)\)extends this to logical conjunctions and disjunctions of constraints\. CRANE\(Banerjeeet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib20)\)applies constrained generation specifically to reasoning tasks\. Grammar\-constrained decoding\(Willard and Louf,[2023](https://arxiv.org/html/2608.05254#bib.bib34)\)ensures outputs conform to formal grammars\. Unlike these approaches,CFRkeeps constraints in natural\-language prompt context and does not use a symbolic solver or constrained decoder\. It is training\-free and can be applied to black\-box backbones, but its effectiveness depends on the backbone’s Stage 1 extraction quality\.

### O\.3Structured Prompting for Mathematics

Beyond the approaches discussed in the main text, several structured prompting strategies relate toCFR:

##### Decomposition approaches\.

Zhouet al\.\([2023](https://arxiv.org/html/2608.05254#bib.bib10)\)decompose complex problems into simpler sub\-questions\. WhileCFRalso performs a preliminary analysis step, the output is not a problem decomposition but a constraint specification—a fundamentally different structure that complements rather than replaces decomposition\.

##### Program\-aided reasoning\.

PAL\(Gaoet al\.,[2023](https://arxiv.org/html/2608.05254#bib.bib17)\)and PoT\(Chenet al\.,[2023](https://arxiv.org/html/2608.05254#bib.bib30)\)translate problems into executable code, gaining correctness guarantees for computation\.CFRprovides a softer form of verification: constraints are not formally verified by a theorem prover but checked by the model during reasoning\. This makesCFRapplicable to problems that resist formalization \(e\.g\., those requiring geometric insight or combinatorial arguments\)\.

##### Process supervision\.

Lightmanet al\.\([2024](https://arxiv.org/html/2608.05254#bib.bib15)\)train process reward models \(PRMs\) to evaluate each reasoning step\.CFR’s interleaved constraint checking can be seen as a prompt\-based approximation of process supervision: the constraint specification acts as a lightweight “reward model” that the solver uses to self\-evaluate intermediate results\.

##### Structured representations beyond text\.

Structured object representations for vision\-language spatial reasoning\(Maet al\.,[2026](https://arxiv.org/html/2608.05254#bib.bib42)\)and plan–generate–verify loops for parametric CAD editing\([Maet al\.,](https://arxiv.org/html/2608.05254#bib.bib43)\)similarly preserve task\-relevant structure across multi\-step generation\. These are distinct modalities and tasks, but they motivate studying whether an explicit intermediate specification can improve reliability beyond mathematical text\.

### O\.4Constrained Reasoning in Classical AI

##### Constraint satisfaction\.

The CSP framework\(Dechter,[2003](https://arxiv.org/html/2608.05254#bib.bib27)\)is a useful analogy, but not a theoretical foundation for CFR\. Stage 1 extracts and summarizes restrictions in natural language, and Stage 2 checks them in a prompt; neither step implements arc consistency or formal backtracking\.

##### Planning with constraints\.

Classical AI planners \(STRIPS, PDDL\) maintain preconditions and postconditions for actions\.CFR’s interleaved checking is analogous to precondition verification: before proceeding to the next reasoning step, the solver confirms that the current state satisfies all known constraints\.

### O\.5Test\-Time Computation

##### Scaling laws\.

Snellet al\.\([2025](https://arxiv.org/html/2608.05254#bib.bib21)\)show that allocating more test\-time compute can be more effective than scaling model parameters\. CFR is a targeted allocation of additional compute, but Table[3](https://arxiv.org/html/2608.05254#S5.T3)shows that its gains must be evaluated jointly with its non\-trivial token overhead; we make no equivalence claim to scaling model size\.

##### Budget allocation\.

Muennighoffet al\.\([2025](https://arxiv.org/html/2608.05254#bib.bib22)\)explore simple test\-time scaling through longer thinking\.CFRprovides a structured way to allocate the additional budget: rather than simply allowing the model to “think more,” it directs the extra computation toward constraint extraction, which has higher information density than additional free\-form reasoning\.

### O\.6Inference\-Time Interventions

##### Prompting as intervention\.

Our work contributes to the growing literature on inference\-time interventions that improve reasoning without training\. Unlike approaches that modify decoding \(beam search variants, best\-of\-nn\) or post\-process outputs \(self\-consistency, majority voting\),CFRmodifies the*information available to the model*\. This places it closer to retrieval\-augmented generation \(RAG\) conceptually—but instead of retrieving external knowledge,CFRextracts latent knowledge from the problem itself\.

## Appendix PDetailed Positive Cases by Constraint Type

We group the positive cases by the dominant constraint type exposed by the problem statement and required by the successful CFR trace\. Each category first lists the detailed CoT–CFR comparison tables, followed by natural\-language analyses that restate the problem, answer, and the specific constraint mechanism\.

### P\.1Geometric Configuration and Branch Constraints

These cases test whether the model can preserve orientation, cyclic order, sign choices, vector closure, and metric branch conditions before doing algebra\. CFR helps by making geometric feasibility constraints explicit, especially when several algebraic branches look locally plausible\.

#### P\.1\.1Detailed Tables

Table 29:Detailed positive case 1 where CFR corrects CoT by enforcing explicit constraints\.Example 1: Ratio\-and\-Reflection Geometry \(DeepSeek\-32K, AIME 2025\)31\.1% token reductionProblem\.In△​A​B​C\\triangle ABC, pointsD,ED,Elie onA​B¯\\overline\{AB\}and pointsF,GF,Glie onA​C¯\\overline\{AC\}\. GivenA​D=4AD=4,D​E=16DE=16,E​B=8EB=8,A​F=13AF=13,F​G=52FG=52,G​C=26GC=26, letMMbe the reflection ofDDthroughFFandNNbe the reflection ofGGthroughEE\. If\[D​E​G​F\]=288\[DEGF\]=288, find\[A​F​N​B​C​E​M\]\[AFNBCEM\]\.Ground Truth:588588CoT:33,065 tokensCFR:22,791 tokensCoTCFRCoT observes thatD,FD,FandE,GE,Gdivide the two sides in the same ratios, but keeps the solution as a free\-form geometric narrative\.It does not turn the given area\[D​E​G​F\]=288\[DEGF\]=288into the key constraint onsin⁡A\\sin A, and the reflected pointsM,NM,Nare not explicitly encoded\.As a result, the target heptagon is no longer controlled by the original construction, and the area computation drifts\.CFR first extracts the proportional structure:A​DA​B=A​FA​C=17,A​EA​B=A​GA​C=57\.\\frac\{AD\}\{AB\}=\\frac\{AF\}\{AC\}=\\frac\{1\}\{7\},\\qquad\\frac\{AE\}\{AB\}=\\frac\{AG\}\{AC\}=\\frac\{5\}\{7\}\.It then converts the area condition into a hard trigonometric constraint:\[D​E​G​F\]=624​sin⁡A=288⇒sin⁡A=613\.\[DEGF\]=624\\sin A=288\\quad\\Rightarrow\\quad\\sin A=\\frac\{6\}\{13\}\.Finally, CFR encodes the reflections directly:M=2​F−D,N=2​E−G\.M=2F\-D,\\qquad N=2E\-G\.Using shoelace onA​F​N​B​C​E​MAFNBCEMgives\[A​F​N​B​C​E​M\]=1274​sin⁡A=588\[AFNBCEM\]=1274\\sin A=588\.Answer:1\\boxed\{1\}×\\timesAnswer:588\\boxed\{588\}✓Table 30:Detailed positive case 2 where CFR corrects CoT by enforcing explicit constraints\.Example 2: Cyclic\-Constraint Geometry \(Qwen3\.5\-9B\-32K, AIME 2024\)35\.3% token reductionProblem\.RectanglesA​B​C​DABCDandE​F​G​HEFGHare drawn such thatD,E,C,FD,E,C,Fare collinear\. Also,A,D,H,GA,D,H,Gall lie on a circle\. IfB​C=16BC=16,A​B=107AB=107,F​G=17FG=17, andE​F=184EF=184, find the length ofC​ECE\.Ground Truth:104104CoT:33,015 tokensCFR:21,370 tokensCoTCFRCoT sets up coordinates but does not enforce the relative vertical orientation of the two rectangles\.It treats the second rectangle as if it can be placed on the same side of the baseline without checking whether the concyclicity condition remains valid\.As a result, the circle constraint is applied to the wrong geometric configuration, leading to an incorrect value ofC​ECE\.CFR first fixes the coordinate constraints:D=\(0,0\),C=\(107,0\),A=\(0,16\)\.D=\(0,0\),\\qquad C=\(107,0\),\\qquad A=\(0,16\)\.It then uses the concyclicity ofA,D,H,GA,D,H,Gto determine the correct orientation:HHandGGmust lie on the opposite side of the baseline fromAA\.E=\(x,0\),F=\(x\+184,0\),E=\(x,0\),\\qquad F=\(x\+184,0\),H=\(x,−17\),G=\(x\+184,−17\)\.H=\(x,\-17\),\\qquad G=\(x\+184,\-17\)\.The circle throughAAandDDhas center ony=8y=8, while chordH​GHGforces the same center to havexx\-coordinatex\+92x\+92\.\(x\+92\)2\+82=922\+252\.\(x\+92\)^\{2\}\+8^\{2\}=92^\{2\}\+25^\{2\}\.Thus\(x\+92\)2=952\(x\+92\)^\{2\}=95^\{2\}, sox=3x=3andC​E=107−3=104CE=107\-3=104\.Answer:64\\boxed\{64\}×\\timesAnswer:104\\boxed\{104\}✓
#### P\.1\.2Natural\-Language Analyses

##### Case 1: Ratio\-and\-reflection geometry\.

Problem\.In a triangle, points on two sides are placed at specified segment lengths, the quadrilateralD​E​G​FDEGFhas area288288, and pointsM,NM,Nare defined by reflections\. The target is the area ofA​F​N​B​C​E​MAFNBCEM\.Answer\.588588\.Analysis\.The key is that the side ratios force parallel proportional structure, while the given area fixessin⁡A\\sin A\. CFR succeeds because it writes these constraints and the reflection equations before computing the final area, preventing the solution from drifting away from the constructed polygon\.

##### Case 2: Cyclic\-constraint geometry\.

Problem\.Two rectangles are arranged on the same baseline, and four verticesA,D,H,GA,D,H,Gare concyclic\. Given the side lengths, findC​ECE\.Answer\.104104\.Analysis\.The cyclic condition is not just a generic circle fact; it determines the relative vertical orientation of the two rectangles\. CFR enforces this orientation first and then solves the circle\-center equation, while CoT can easily apply concyclicity to the wrong configuration\.

### P\.2Algebraic, Modular, and Divisibility Constraints

These cases are governed by invariants, modular residues, divisibility filters, or extremal algebraic reductions\. CFR is useful because it turns broad computation into a smaller feasible set determined by exact arithmetic constraints\.

#### P\.2\.1Detailed Tables

Table 31:Detailed positive case 3 where CFR corrects CoT by enforcing explicit constraints\.Example 3: Degree\-Weighted Grid Optimization \(DeepSeek\-32K, AIME 2026\)69\.2% token reductionProblem\.The integers from11to6464are placed into an8×88\\times 8grid\. LetMMbe the sum of absolute differences across all adjacent horizontal and vertical cell pairs\. Find the maximum possible value ofMMmodulo10001000\.Ground Truth:896896CoT:33,069 tokensCFR:10,192 tokensCoTCFRCoT relies on vague checkerboard intuition and memory of a similar problem rather than formalizing the optimization\.It does not convert the grid into a bipartite graph with vertex\-degree weights, so the assignment of large and small numbers remains heuristic\.The reasoning stalls near the token limit and does not produce a reliable modular maximum\.CFR models the grid as a bipartite graph\. The two parts each contain3232vertices, with degree counts18​of degree​4,12​of degree​3,2​of degree​2\.18\\text\{ of degree \}4,\\qquad 12\\text\{ of degree \}3,\\qquad 2\\text\{ of degree \}2\.The maximum is achieved by placing the3232largest numbers on one side and the3232smallest on the other, ordered by degree\.High contribution=4​\(999\)\+3​\(486\)\+2​\(67\)=5588,\\text\{High contribution\}=4\(999\)\+3\(486\)\+2\(67\)=5588,Low contribution=4​\(171\)\+3​\(294\)\+2​\(63\)=1692\.\\text\{Low contribution\}=4\(171\)\+3\(294\)\+2\(63\)=1692\.ThusMmax=5588−1692=3896≡896\(mod1000\)M\_\{\\max\}=5588\-1692=3896\\equiv 896\\pmod\{1000\}\.Answer:invalid×\\timesAnswer:896\\boxed\{896\}✓Table 32:Detailed positive case 4 where CFR corrects CoT by enforcing explicit constraints\.Example 4: Rational Recurrence Invariant \(DeepSeek\-32K, AIME 2025\)60\.6% token reductionProblem\.Letx1=2511x\_\{1\}=\\frac\{25\}\{11\}andxk\+1=13​\(xk\+1xk−1\)x\_\{k\+1\}=\\frac\{1\}\{3\}\\left\(x\_\{k\}\+\\frac\{1\}\{x\_\{k\}\}\-1\\right\)\. Ifx2025=mnx\_\{2025\}=\\frac\{m\}\{n\}in lowest terms, find the remainder whenm\+nm\+nis divided by10001000\.Ground Truth:248248CoT:33,021 tokensCFR:12,999 tokensCoTCFRCoT expands the first few rational terms directly\. The numerators and denominators grow quickly, and the derivation becomes trapped in arithmetic rather than structure\.It does not identify the invariant quantity that controlsm\+nm\+n, so the long computation leads to an incorrect small answer\.CFR introducesxk=pk/qkx\_\{k\}=p\_\{k\}/q\_\{k\}in lowest terms and tracksSk=pk\+qk\.S\_\{k\}=p\_\{k\}\+q\_\{k\}\.The recurrence impliespk\+1=pk2−pk​qk\+qk23,qk\+1=pk​qk,p\_\{k\+1\}=\\frac\{p\_\{k\}^\{2\}\-p\_\{k\}q\_\{k\}\+q\_\{k\}^\{2\}\}\{3\},\\qquad q\_\{k\+1\}=p\_\{k\}q\_\{k\},soSk\+1=\(pk\+qk\)23=Sk23\.S\_\{k\+1\}=\\frac\{\(p\_\{k\}\+q\_\{k\}\)^\{2\}\}\{3\}=\\frac\{S\_\{k\}^\{2\}\}\{3\}\.ThusS2025=222025​322024\+1S\_\{2025\}=2^\{2^\{2025\}\}3^\{2^\{2024\}\+1\}\. Reducing modulo88and125125, then applying CRT, gives248248\.Answer:2\\boxed\{2\}×\\timesAnswer:248\\boxed\{248\}✓
#### P\.2\.2Natural\-Language Analyses

##### Case 3: Degree\-weighted grid optimization\.

Problem\.Three distinguished lattice points in a7×77\\times 7grid generate a value by summing squared distances from all grid points; the task is to find the maximum value modulo10001000\.Answer\.896896\.Analysis\.This problem is an optimization over a finite grid, so the structural constraint is the degree\-weighted contribution of each chosen point\. CFR converts the objective into a separable weighted\-distance expression and selects the corner\-extreme configuration, avoiding unsupported local search\.

##### Case 4: Rational recurrence invariant\.

Problem\.A rational recurrence starts fromx1=25/11x\_\{1\}=25/11, and one must compute the remainder ofm\+nm\+nwhenx2025=m/nx\_\{2025\}=m/nis in lowest terms\.Answer\.248248\.Analysis\.The recurrence looks computationally impossible if expanded directly\. CFR identifies the invariant forpk\+qkp\_\{k\}\+q\_\{k\}under the recurrence, turning a long rational iteration into modular exponentiation\.

### P\.3Functional, Probabilistic, and Locus Constraints

These cases require splitting a function, probability distribution, or locus into valid branches\. CFR improves reliability by forcing the model to check domains, endpoint exclusions, conditional cases, and real\-valued feasibility before aggregating results\.

#### P\.3\.1Detailed Tables

Table 33:Detailed positive case 5 where CFR corrects CoT by enforcing explicit constraints\.Example 5: Sawtooth\-Parabola Intersections \(DeepSeek\-32K, AIME 2025\)24\.8% token reductionProblem\.A periodic sawtooth functionffintersects the parabolax=34​y2x=34y^\{2\}\. The sum of all intersectionyy\-coordinates isa\+b​cd\\frac\{a\+b\\sqrt\{c\}\}\{d\}\. Finda\+b\+c\+da\+b\+c\+d\.Ground Truth:259259CoT:33,700 tokensCFR:25,346 tokensCoTCFRCoT tries to solve the intersection equation across many periods, but the valid interval constraints are not consistently enforced\.It over\-accumulates candidate roots and produces a nonsensical large integer instead of the requested radical\-form parameter sum\.CFR usesx=34​y2x=34y^\{2\}andy=f​\(x\)y=f\(x\), soy∈\[−1,1\]y\\in\[\-1,1\]andx∈\[0,34\]x\\in\[0,34\]\. It splitsx=4​m\+tx=4m\+tinto the two sawtooth branches\.On one branch, the quadratic has root sum1/341/34; on the other, the root sum is−1/34\-1/34\. These sums cancel across complete periods\.Only the boundary period remains, where one root is invalid and must be discarded\. The sum is1\+5​18568,\\frac\{1\+5\\sqrt\{185\}\}\{68\},soa\+b\+c\+d=1\+5\+185\+68=259a\+b\+c\+d=1\+5\+185\+68=259\.Answer:487372\\boxed\{487372\}×\\timesAnswer:259\\boxed\{259\}✓Table 34:Detailed positive case 6 where CFR corrects CoT by enforcing explicit constraints\.Example 6: Random Function Expectation \(DeepSeek\-32K, CMIMC 2025\)\+229\.0% tokensProblem\.For a uniformly random functionf:\{1,…,25\}→\{1,…,25\}f:\\\{1,\\ldots,25\\\}\\to\\\{1,\\ldots,25\\\}, compute𝔼​∑x=125\(f​\(f​\(x\)\)−x\)2\\mathbb\{E\}\\sum\_\{x=1\}^\{25\}\(f\(f\(x\)\)\-x\)^\{2\}\.Ground Truth:24962496CoT:5,376 tokensCFR:17,687 tokensCoTCFRCoT computes the term forx=1x=1and multiplies by2525, incorrectly assuming all summands have the same distribution\.This ignores that the term\(U−x\)2\(U\-x\)^\{2\}depends on the value ofxx, so the apparent symmetry is false\.CFR keepsxxsymbolic\. For fixedxx, letZ=f​\(f​\(x\)\)Z=f\(f\(x\)\)\. ThenZ=x​with probability​125,Z=x\\text\{ with probability \}\\frac\{1\}\{25\},and otherwiseZZis uniform on\{1,…,25\}\\\{1,\\ldots,25\\\}with probability2425\\frac\{24\}\{25\}\.Thus𝔼​\(Z−x\)2=2425​\(52\+\(13−x\)2\)\.\\mathbb\{E\}\(Z\-x\)^\{2\}=\\frac\{24\}\{25\}\\left\(52\+\(13\-x\)^\{2\}\\right\)\.Summing overx=1,…,25x=1,\\ldots,25gives2425​∑x=125\(52\+\(13−x\)2\)=2496\.\\frac\{24\}\{25\}\\sum\_\{x=1\}^\{25\}\\left\(52\+\(13\-x\)^\{2\}\\right\)=2496\.Answer:4704\\boxed\{4704\}×\\timesAnswer:2496\\boxed\{2496\}✓
#### P\.3\.2Natural\-Language Analyses

##### Case 5: Sawtooth\-parabola intersections\.

Problem\.A periodic sawtooth functionffintersects the parabolax=34​y2x=34y^\{2\}; the sum of all intersectionyy\-coordinates is written asa\+b​cd\\frac\{a\+b\\sqrt\{c\}\}\{d\}, and the task asks fora\+b\+c\+da\+b\+c\+d\.Answer\.259259\.Analysis\.The problem becomes tractable only after splitting the sawtooth function into its valid branches and enforcingy∈\[−1,1\]y\\in\[\-1,1\]\. CFR respects the interval constraints, cancels complete\-period root sums, and keeps only the boundary contribution that determines the radical\-form answer\.

##### Case 6: Random function expectation\.

Problem\.For a uniformly random functionf:\{1,…,25\}→\{1,…,25\}f:\\\{1,\\ldots,25\\\}\\to\\\{1,\\ldots,25\\\}, compute𝔼​∑x\(f​\(f​\(x\)\)−x\)2\\mathbb\{E\}\\sum\_\{x\}\(f\(f\(x\)\)\-x\)^\{2\}\.Answer\.24962496\.Analysis\.The important constraint is conditional:f​\(f​\(x\)\)f\(f\(x\)\)equalsxxwith one probability and otherwise behaves uniformly\. CFR keepsxxsymbolic, so the variance\-like term\(13−x\)2\(13\-x\)^\{2\}is preserved instead of being washed out by a false symmetry argument\.

### P\.4Discrete Enumeration, Symmetry, and Graph Constraints

These cases are dominated by finite structure: block decompositions, symmetry classes, graph correspondences, maximality, and forced rows or columns\. CFR helps by extracting the combinatorial object first, which reduces overcounting and prevents invalid configurations from entering the count\.

#### P\.4\.1Detailed Tables

Table 35:Detailed positive case 7 where CFR corrects CoT by enforcing explicit constraints\.Example 7: Semi\-Magic Square Counting \(DeepSeek\-32K, BRUMO 2025\)67\.2% token reductionProblem\.Digits11through99are placed in a3×33\\times 3grid so that all rows and columns have the same sum\. Diagonals need not have the same sum\. Count the number of valid grids\.Ground Truth:7272CoT:32,971 tokensCFR:10,806 tokensCoTCFRCoT correctly observes that the common row and column sum must be1515, but then drifts among known facts about magic squares, Latin squares, and semi\-magic squares\.The trace repeatedly second\-guesses whether the count should be7272,288288, or a related known value, leaving the answer unstable\.CFR fixes the invariant first: since1\+2\+⋯\+9=451\+2\+\\cdots\+9=45, each row and column must sum to1515\.It then enumerates the feasible triples:\{1,5,9\},\{1,6,8\},\{2,4,9\},\{2,5,8\},\\\{1,5,9\\\},\\\{1,6,8\\\},\\\{2,4,9\\\},\\\{2,5,8\\\},\{2,6,7\},\{3,4,8\},\{3,5,7\},\{4,5,6\}\.\\\{2,6,7\\\},\\\{3,4,8\\\},\\\{3,5,7\\\},\\\{4,5,6\\\}\.A systematic partition\-and\-permutation count gives exactly7272semi\-magic grids\.Answer:unstable×\\timesAnswer:72\\boxed\{72\}✓Table 36:Detailed positive case 8 where CFR corrects CoT by enforcing explicit constraints\.Example 8: Sudoku\-Style Counting \(Qwen3\.5\-9B\-32K, AIME 2025\)\+2\.4% tokensProblem\.The2727cells of a3×93\\times 9Sudoku\-style band are filled using digits11through99so that every row and each3×33\\times 3block contains all digits\. If the count ispa​qb​rc​sdp^\{a\}q^\{b\}r^\{c\}s^\{d\}, computep​a\+q​b\+r​c\+s​dpa\+qb\+rc\+sd\.Ground Truth:8181CoT:33,446 tokensCFR:34,247 tokensCoTCFRCoT fails to return a stable parsed answer and does not cleanly isolate the structural count of the middle block\.The key missing component is the number of feasible second\-block set assignments after the first block has fixed row\-wise digit sets\.CFR decomposes the grid by3×33\\times 3blocks\. The first block has9\!9\!fillings\.Given the first block, the second block requires choosing row sets that avoid the corresponding first\-block row sets and still partition\{1,…,9\}\\\{1,\\ldots,9\\\}\. This contributes the structural multiplier5656\.N=9\!⋅56⋅\(3\!\)3⋅\(3\!\)3\.N=9\!\\cdot 56\\cdot\(3\!\)^\{3\}\\cdot\(3\!\)^\{3\}\.ThereforeN=216​310​5⋅72N=2^\{16\}3^\{10\}5\\cdot 7^\{2\}, and2⋅16\+3⋅10\+5\+7⋅2=81\.2\\cdot 16\+3\\cdot 10\+5\+7\\cdot 2=81\.Answer:None×\\timesAnswer:81\\boxed\{81\}✓
#### P\.4\.2Natural\-Language Analyses

##### Case 7: Semi\-magic square counting\.

Problem\.Place digits11through99in a3×33\\times 3grid so that all rows and columns have the same sum, while diagonals are unrestricted; count the valid grids\.Answer\.7272\.Analysis\.The total sum forces every row and column to sum to1515\. CFR first fixes this invariant and enumerates the feasible triples before counting partitions and permutations, which avoids drifting between magic\-square facts and the weaker semi\-magic condition\.

##### Case 8: Sudoku\-style counting\.

Problem\.Count valid3×93\\times 9Sudoku\-style fillings and express the result as a prime factorization, then compute the requested weighted exponent sum\.Answer\.8181\.Analysis\.The decisive missing factor is the number of feasible middle\-block assignments\. CFR keeps the block\-compatibility constraint explicit, inserts the multiplier5656, and therefore factors the correct total rather than an incomplete count\.

## Appendix QFull Constraint Taxonomy with Problem Examples

For each constraint type, we provide a canonical AIME problem example and the expected Stage 1 output\.

### Q\.1Domain Constraints

Example: “Find the number of positive integersn<1000n<1000…”Extracted: C1: type=domain, desc="n is a positive integer" C2: type=bound, desc="n < 1000" C3: type=domain, desc="answer is a count \(non\-negative integer\)" Propagated: P1: n in \{1, 2, \.\.\., 999\}, answer in \{0, 1, \.\.\., 999\}

### Q\.2Modular Constraints

Example: “…find the remainder whenNNis divided by 1000\.”Extracted: C1: type=modular, desc="final answer = N mod 1000" C2: type=bound, desc="answer in \[0, 999\]" C3: type=domain, desc="answer is an integer" Propagated: P1: answer is an integer in \[0, 999\] Critical:Must apply mod 1000 as the very last step\.

### Q\.3Format Constraints

Example: “…can be expressed aspq\\frac\{p\}\{q\}wheregcd⁡\(p,q\)=1\\gcd\(p,q\)=1\. Findp\+qp\+q\.”Extracted: C1: type=format, desc="express as p/q with gcd\(p,q\)=1" C2: type=format, desc="final answer = p \+ q" C3: type=domain, desc="p, q are positive integers" Propagated: P1: answer = p\+q where p/q is in lowest terms, answer \> 1 Critical:Must reduce fraction before computing p\+q\.

### Q\.4Parity Constraints

Example: “Find the number of even positive integersn≤100n\\leq 100…”Extracted: C1: type=parity, desc="n must be even" C2: type=domain, desc="n is a positive integer" C3: type=bound, desc="n <= 100" Propagated: P1: n in \{2, 4, 6, \.\.\., 100\}, 50 candidates Critical:Only enumerate even values\.

### Q\.5Bound Constraints

Example: “Find the largest integernnsuch thatn3<10000n^\{3\}<10000\.”Extracted: C1: type=bound, desc="nˆ3 < 10000" C2: type=domain, desc="n is an integer" C3: type=bounds\_or\_extremal, desc="find largest such n" Propagated: P1: n <= 21 \(since 21ˆ3=9261 < 10000, 22ˆ3=10648 \> 10000\) Critical:Answer is 21, must verify both directions\.

### Q\.6Structure Constraints

Example: “…the number of permutations of\{1,…,n\}\\\{1,\.\.\.,n\\\}that are involutions\.”Extracted: C1: type=structure, desc="permutation must be an involution \(p\(p\(i\)\)=i\)" C2: type=domain, desc="answer is a count" C3: type=structure, desc="involutions consist of fixed points and 2\-cycles" Propagated: P1: answer = sum over k of C\(n,2k\) \* \(2k\-1\)\!\! Critical:Do not count general permutations\.

## Appendix RBroader Impact

CFRis a purely methodological contribution to mathematical reasoning\. It does not involve data collection from human subjects or new privacy\-sensitive data\. By reducing some constraint\-violation errors, it may improve the reliability of AI\-assisted mathematics; however, its summaries can also be incomplete or invalid, so it should not be used as a guarantee of mathematical correctness\. The technique is training\-free and does not require parameter updates, but its effectiveness varies with backbone quality and adds inference cost\.

Although CFR is not an interactive or safety\-critical system, work on red\-teaming policies and harm amplification in LLM interactions\(Guoet al\.,[2026a](https://arxiv.org/html/2608.05254#bib.bib35),[b](https://arxiv.org/html/2608.05254#bib.bib36)\)underscores the importance of evaluating any intervention within its stated scope and avoiding claims that extend beyond the measured setting\.

A potential concern is thatCFRcould contribute to overreliance on AI for mathematical problem\-solving in educational settings\. We note thatCFR’s explicit constraint\-extraction step could also serve as a pedagogical tool: students could learn systematic constraint identification by examiningCFR’s Stage 1 outputs\.

## Appendix SFuture Directions

We outline several promising directions for extendingCFRbeyond the current work\.

##### Learned constraint extraction\.

The current Stage 1 relies entirely on prompting\. Fine\-tuning a lightweight model specifically for constraint extraction could improve both precision and speed\. A distilled 1B\-parameter extractor, trained on\(p​r​o​b​l​e​m,c​o​n​s​t​r​a​i​n​t​s\)\(problem,constraints\)pairs generated by DeepSeek\-V4\-Pro, could serve as a universal plug\-in for any downstream solver at minimal cost\.

##### Multi\-turn constraint refinement\.

Currently, constraints are extracted once and passed to the solver without further interaction\. A multi\-turn variant could allow the solver to query the constraint module when encountering ambiguity—e\.g\., “Does constraint C3 apply to intermediate variablekkor only to the final answer?” This would address 23% of our observed failure cases where constraint scope was misinterpreted\. Interactive\-guidance policy optimization, heterogeneous\-agent collaboration, and hierarchical negative feedback for personalized styling offer related directions for structuring iterative feedback\(Liuet al\.,[2026](https://arxiv.org/html/2608.05254#bib.bib41); Zhanget al\.,[2026](https://arxiv.org/html/2608.05254#bib.bib47); Maet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib48)\), but are outside the scope of the present training\-free method\.

##### Domain extension beyond mathematics\.

The core principle—extract structural constraints before solving—applies to any domain with well\-defined answer formats\. Related work uses LLM\-driven semantic disambiguation and dynamic visual focus in medical diagnosis\(Zhuet al\.,[2025](https://arxiv.org/html/2608.05254#bib.bib44),[2026](https://arxiv.org/html/2608.05254#bib.bib45)\); these results motivate, but do not establish, a corresponding extension of CFR beyond mathematical text:

- •Code generation: Extract type signatures, input/output format constraints, and edge\-case specifications before generating code\.
- •Legal reasoning: Extract jurisdictional constraints, applicable statutes, and precedent requirements before drafting arguments\.
- •Scientific computing: Extract physical units, conservation laws, and boundary conditions before deriving formulas\.
- •Formal verification: Extract pre/post\-conditions and loop invariants before synthesizing proofs\.

##### Adaptive routing with soft scores\.

The current binary router \(use CFR or not\) could be extended to a soft scorer that modulates the constraint extraction budget based on estimated constraint density\. Problems with many detected cues would receive larger Stage 1 budgets; problems with few cues would receive minimal extraction\. This complements work on whether reasoning models can identify when to stop allocating internal reasoning\(Huanget al\.,[2026](https://arxiv.org/html/2608.05254#bib.bib46)\)\. Preliminary analysis suggests this could reduce average token overhead by 18% while maintaining accuracy\.

##### Integration with search\-based methods\.

CFRis orthogonal to tree search approaches like Tree of Thoughts\(Yaoet al\.,[2023a](https://arxiv.org/html/2608.05254#bib.bib11)\)\. Constraints could serve as pruning criteria: any branch producing an intermediate result inconsistent with propagated constraints is immediately abandoned\. This is analogous to constraint propagation in classical CSP solvers\(Dechter,[2003](https://arxiv.org/html/2608.05254#bib.bib27)\)and could dramatically reduce the effective branching factor\.

##### Benchmark development\.

Our work highlights the need for benchmarks specifically designed to test constraint handling in LLMs\. An ideal benchmark would include:

1. 1\.Problems with explicit constraints at varying complexity levels\.
2. 2\.Problems with implicit constraints requiring inference\.
3. 3\.Adversarial problems where surface\-level constraint cues are misleading\.
4. 4\.Multi\-constraint problems where individual constraint satisfaction is easy but joint satisfaction requires careful reasoning\.

Such a benchmark would enable more targeted evaluation of methods likeCFRand drive further research in constraint\-aware reasoning\.

##### Theoretical analysis\.

A formal analysis of when constraint\-first decomposition provably helps versus standard monolithic reasoning remains open\. Key questions include: \(1\) Under what problem distributions does the constraint\-guided solver have strictly lower error probability? \(2\) What is the optimal allocation of compute between extraction and solving as a function of constraint complexity? \(3\) Can we derive PAC\-style bounds on the extraction quality needed to guarantee net positive gain?