HypoLoop: Revising Weight-Editing Plans from Scientific Feedback

arXiv cs.LG Papers

Summary

HypoLoop is a family of native weight-editing methods that revises which parameters to edit and how errors drive fitting based on scientific feedback, validated across 22 scientific tasks with DeepSeek and Claude, yielding notable error reductions on Burgers and DIODE benchmarks.

arXiv:2611.23718v1 Announce Type: new Abstract: Scientific experiments continually reveal prediction errors. Effective updates depend on which parameters change and which errors drive the correction. We introduce HypoLoop, a family of native weight-editing methods that connects these choices to experimental feedback. Fixed, numerically adaptive, and LLM-guided policies produce editing plans; numerical solvers compute weight patches, and internal validation selects the deployed predictor. Successive observations and validation records support revisions to editable locations and fitting rules. Experiments cover 22 scientific tasks and both DeepSeek and Claude. On Burgers, reallocating a matched parameter budget reduces error by 58.80% and 47.72% relative to fixed locations. On DIODE, positive-residual weighting reduces absolute relative error (AbsRel) by 13.35% in internal cross-validation, with the same 33 editable coordinates. Revising the complete plan across rounds lowers final AbsRel by 10.59% relative to keeping the initial plan fixed. SpaceNet7 and Make3D connect accepted edits to improved spatial predictions. These results show how experimental evidence can shape the update problem itself. Code: https://github.com/limengran98/HypoLoop.
Original Article
View Cached Full Text

Cached at: 11/19/26, 09:02 AM

# 1Introduction
Source: [https://arxiv.org/html/2611.23718](https://arxiv.org/html/2611.23718)
HypoLoop: Revising Weight\-Editing Plans from Scientific Feedback

Mengran Li1, Xichen Yan2, Bo Li3, Chengyang Zhang4, Jinfeng Xu5,\*, Zheng Lin6

Zelin Zang1,\*, Zhen Lei7, Jiebo Luo8, Victor C\. M\. Leung5, Stan Z\. Li9

1Hong Kong Institute of Science and Innovation2Jinan University3University of Macau

4Sichuan University5The University of British Columbia6University of Luxembourg

7Institute of Automation, Chinese Academy of Sciences8University of Rochester9Westlake University

[limengran1998@163\.com](mailto:[email protected])

\*Co\-corresponding authors: Jinfeng Xu and Zelin Zang\.

Abstract\.Scientific experiments continually reveal prediction errors\. Effective updates depend on which parameters change and which errors drive the correction\. We introduce HypoLoop, a family of native weight\-editing methods that connects these choices to experimental feedback\. Fixed, numerically adaptive, and LLM\-guided policies produce editing plans; numerical solvers compute weight patches, and internal validation selects the deployed predictor\. Successive observations and validation records support revisions to editable locations and fitting rules\. Experiments cover 22 scientific tasks and both DeepSeek and Claude\. On Burgers, reallocating a matched parameter budget reduces error by58\.80%58\.80\\%and47\.72%47\.72\\%relative to fixed locations\. On DIODE, positive\-residual weighting reduces absolute relative error \(AbsRel\) by 13\.35% in internal cross\-validation, with the same 33 editable coordinates\. Revising the complete plan across rounds lowers final AbsRel by10\.59%10\.59\\%relative to keeping the initial plan fixed\. SpaceNet7 and Make3D connect accepted edits to improved spatial predictions\. These results show how experimental evidence can shape the update problem itself\.

## 1Introduction

Figure 1:Feedback can revise the update problem\.HypoLoop reconsiders where and how to edit native weights\. Burgers compares editing locations at matched budgets; DIODE compares weighting rules at fixed locations\.Scientific prediction models help researchers compare conditions and anticipate outcomes before completing costly measurements or simulations\[[24](https://arxiv.org/html/2611.23718#bib.bib24),[33](https://arxiv.org/html/2611.23718#bib.bib33)\]\. As experiments proceed, new observations expose prediction errors and provide evidence for improving the model\[[19](https://arxiv.org/html/2611.23718#bib.bib19)\]\. Using this evidence requires two choices: which weights to change, and how the observed errors should drive those changes\.

These choices define theupdate problem\. A fixed editing plan repeatedly fits the same parameter subset with the same objective as feedback accumulates\[[51](https://arxiv.org/html/2611.23718#bib.bib51),[21](https://arxiv.org/html/2611.23718#bib.bib21)\]\. Yet different locations and objectives can produce different corrections from identical observations\. The parameter subset determines which changes the model can express; the objective determines which errors receive priority and how much existing predictions may change\. Both choices can become outdated as experiments reveal new error patterns\[[15](https://arxiv.org/html/2611.23718#bib.bib15),[23](https://arxiv.org/html/2611.23718#bib.bib23)\]\.

Consider a depth predictor that consistently overestimates distance in newly observed scenes\. Editing its output layer can correct an overall bias, while editing an internal representation can change how it distinguishes scene conditions\. At either location, emphasizing positive residuals directs the update toward overestimated depths\. Uniform weighting distributes the fitting effort differently\. The same feedback therefore supports several concrete editing plans, whose consequences can be compared through validation\.

We introduceHypoLoop, a family of methods for using experimental feedback to formulate and evaluate native weight edits\. Each editing plan answers*where to edit*and*how to fit the correction*\. The family spans fixed candidate plans, numerical adaptation, and LLM\-guided revision\. LLM\-guided variants read the model structure, prediction errors, and editing history to propose executable changes to the plan\. Numerical solvers fit the resulting weight patches, and internal validation selects the deployed predictor\. Later experiments supply evidence for the next plan \(Figure[1](https://arxiv.org/html/2611.23718#S1.F1)\)\.

Feedback\-Guided Parameter Localizationallocates a limited editing budget across native parameter blocks\. Output weights, hidden layers, and Fourier parameters offer different correction directions\. The localization policy uses model structure, observed errors, and editing history to reconsider this allocation\. Each proposal specifies concrete editable locations, and numerical fitting tests the correction they enable\.

Feedback\-Guided Edit Revisiondetermines how feedback drives changes at the selected locations\. It specifies sample weights, the fitting loss, regularization, reference preservation, and patch scale\. For persistent depth overestimation, the LLM can propose greater weight on positive residuals\. The plan and its validation results enter the editing history and guide subsequent revisions\.

Experiments across 22 scientific tasks compare the HypoLoop family and examine the two editing decisions\. On Burgers, reallocating a matched parameter budget reduces relativeL2L\_\{2\}error by58\.80%58\.80\\%and47\.72%47\.72\\%versus fixed locations under DeepSeek and Claude, respectively\. On DIODE\[[45](https://arxiv.org/html/2611.23718#bib.bib45)\], positive\-residual weighting lowers internal cross\-validation \(CV\) absolute relative error \(AbsRel\) by13\.35%13\.35\\%relative to uniform weighting at the same 33 editable coordinates\. Revising the complete editing plan across rounds lowers final DIODE AbsRel by10\.59%10\.59\\%relative to keeping the initial plan fixed\. SpaceNet7 and Make3D then follow the accepted edits into the model’s spatial predictions\. Together, these studies show how feedback shapes editing locations, fitting rules, and resulting predictions\. Improvements in chemistry, materials, energy, seismic analysis, and industrial inspection further demonstrate the broader applicability of HypoLoop\.

## 2Related Work

#### Localized editing and preservation\.

Model editing corrects particular predictions while limiting changes elsewhere\. ROME targets factual associations in language models\[[26](https://arxiv.org/html/2611.23718#bib.bib26)\], and Arachne uses failing and correctly classified examples to locate weights and evaluate repairs\[[36](https://arxiv.org/html/2611.23718#bib.bib36)\]\. In vision, Yang et al\.\[[51](https://arxiv.org/html/2611.23718#bib.bib51)\]learn sparse parameter masks for individual failures and fine\-tune the selected weights with cross\-entropy\. Surgical fine\-tuning shows that the preferred adaptation layer depends on the distribution shift\[[21](https://arxiv.org/html/2611.23718#bib.bib21)\]\. Focal distillation emphasizes retaining predictions the previous classifier got right\[[49](https://arxiv.org/html/2611.23718#bib.bib49)\]\. HypoLoop revisits editable locations and preservation settings as scientific measurements accumulate, using each plan’s validation results to guide later choices\.

#### Adaptation from sequential feedback\.

Test\-time training constructs self\-supervision from the current unlabeled input\[[37](https://arxiv.org/html/2611.23718#bib.bib37)\]\. Depth\-completion adaptation uses sparse measurements from the same frame to fit an auxiliary layer or a pixelwise prompt\[[29](https://arxiv.org/html/2611.23718#bib.bib29),[17](https://arxiv.org/html/2611.23718#bib.bib17)\]\. In continual and online learning, SparCL changes parameter masks and selects training examples\[[46](https://arxiv.org/html/2611.23718#bib.bib46)\]; SEKF reselects native coordinates using prediction\-loss gradients and applies a filtering update\[[15](https://arxiv.org/html/2611.23718#bib.bib15)\]\. For delayed forecasting targets, X\. Li et al\.\[[23](https://arxiv.org/html/2611.23718#bib.bib23)\]learn a scalar gate for backbone updates from a regression loss\. HypoLoop records predictions before outcomes arrive, then uses the returned measurements and completed validations to revise editing plans for subsequent batches\.

#### Learning update rules and LLM\-guided improvement\.

Learned optimizers infer parameter steps from gradient histories\[[1](https://arxiv.org/html/2611.23718#bib.bib1)\]; bilevel reweighting uses validation performance to determine the influence of training examples\[[31](https://arxiv.org/html/2611.23718#bib.bib31)\]\. Physics\-informed training also adapts the balance among loss terms\[[5](https://arxiv.org/html/2611.23718#bib.bib5)\]\. LLM\-based objective discovery, including DiscoPOP, proposes executable losses and uses candidate evaluations to guide further proposals\[[25](https://arxiv.org/html/2611.23718#bib.bib25)\]\. Scientific agents revise symbolic hypotheses from experimental observations\[[19](https://arxiv.org/html/2611.23718#bib.bib19)\], while weight\-space programming gives agents access to native model weights\[[39](https://arxiv.org/html/2611.23718#bib.bib39),[16](https://arxiv.org/html/2611.23718#bib.bib16),[44](https://arxiv.org/html/2611.23718#bib.bib44)\]\. In WeightLoop, an LLM constructs an editor once, and the resulting program selects and validates weight changes as measurements arrive\[[22](https://arxiv.org/html/2611.23718#bib.bib22)\]\. Its neural editing interface uses a predefined output readout\. HypoLoop uses each round’s errors and validation records to revise both native editing locations and executable fitting rules\.

## 3Method

Figure 2:The HypoLoop editing framework\.\(a\) Feedback and editing history guide location selection, fitting\-rule revision, weight optimization, and validation\. \(b\) Localization contrasts fixed\-pool and full\-inventory parameter selection\. \(c\) The DIODE comparison examines residual weighting at fixed locations\.Experimental feedback reveals prediction errors, but leaves open which parameters should absorb the correction and which errors should drive it\. HypoLoop treats these as two decisions:*where to edit*and*how to fit*\. They define an editing plan\(M,h\)\(M,h\), which numerical optimization turns into a native weight patch\. Validation measures the patch’s effect, and subsequent feedback informs the next plan\. Figure[2](https://arxiv.org/html/2611.23718#S3.F2)shows this process\. The HypoLoop family instantiates it with fixed, numerically adaptive, and LLM\-guided proposal policies\. Appendix[D](https://arxiv.org/html/2611.23718#A4)analyzes these decisions and their effect on native predictions\.

### 3\.1Feedback and Editing Plans

LetfW0f\_\{W\_\{0\}\}be the original predictor,StS\_\{t\}the accumulated feedback at roundtt, andWt−1W\_\{t\-1\}the deployed weights\. A fixed plan solvesΔ​Wt=Solve⁡\(W0,St,M,h\)\\Delta W\_\{t\}=\\operatorname\{Solve\}\(W\_\{0\},S\_\{t\};M,h\)as observations arrive\. To make the plan responsive to those observations, we retain the model’s parameter inventory𝒫\\mathcal\{P\}and an editing historyHt−1H\_\{t\-1\}containing earlier plans, validation scores, and deployment outcomes\. A proposal policyπ\\piuses this evidence to produce

\(Mt,ht\)\\displaystyle\(M\_\{t\},h\_\{t\}\)∈Proposeπ⁡\(𝒫,StatsW0⁡\(St\),Ht−1\),\\displaystyle\\in\\operatorname\{Propose\}\_\{\\pi\}\\\!\\left\(\\mathcal\{P\},\\operatorname\{Stats\}\_\{W\_\{0\}\}\(S\_\{t\}\),H\_\{t\-1\}\\right\),\(1\)ht\\displaystyle h\_\{t\}=\(gt,ℓt,γt,λt,ηt\)\.\\displaystyle=\(g\_\{t\},\\ell\_\{t\},\\gamma\_\{t\},\\lambda\_\{t\},\\eta\_\{t\}\)\.Here,MtM\_\{t\}identifies editable native coordinates\. The fitting configurationhth\_\{t\}specifies sample weightinggtg\_\{t\}, lossℓt\\ell\_\{t\}, regularizationγt\\gamma\_\{t\}, reference preservationλt\\lambda\_\{t\}, and patch scaleηt\\eta\_\{t\}\. Error statistics summarize the original model’s predictions on returned measurements\. The two components below determine the variables and objective of the ensuing optimization\.

### 3\.2Feedback\-Guided Parameter Localization

The same parameter budget can support different corrections at different locations\[[21](https://arxiv.org/html/2611.23718#bib.bib21),[51](https://arxiv.org/html/2611.23718#bib.bib51)\]\. An output\-layer edit can shift a prediction bias; an internal edit can change how the model separates input conditions\. Localization therefore allocates the editing budget using both model structure and observed errors\.

The native inventory lists parameter names, shapes, and available coordinate blocks\. A location proposal selects tensors or contiguous blocks, yielding a coordinate setMMof sizedMd\_\{M\}\. This set determines the directions available to the optimizer\. The proposal is checked against the editing budget and mapped to the original tensors before fitting\.

Our family uses two location policies\. A fixed\-pool policy edits within the native pool established during model setup\. A full\-inventory policy can reselect blocks each round from𝒫\\mathcal\{P\}\. Validation records the corrections achieved by each selection, allowing later feedback to support a new allocation\. The selected coordinates then pass to edit revision, which decides how their values should change\.

### 3\.3Feedback\-Guided Edit Revision

At the same locations, uniform fitting and targeted error correction can produce different patches\. Persistent overestimation suggests emphasizing positive residuals; isolated large residuals can call for robust weighting\[[31](https://arxiv.org/html/2611.23718#bib.bib31),[2](https://arxiv.org/html/2611.23718#bib.bib2)\]\. Edit revision translates such error patterns into a fitting configurationhh\.

The weighting ruleggis an executable expression over residuals, predictions, targets, and feedback ages\. Regression residuals are predictions minus targets, normalized by a fixed task scale\. Evaluatingggon the fitting observations gives positive, bounded weights, normalized toaia\_\{i\}with∑iai=1\\sum\_\{i\}a\_\{i\}=1\. These weights stay fixed within a candidate fit\. Together with the loss, they determine which errors exert the greatest influence; regularization and reference preservation control the extent of the correction\.

Fixed policies use a predefined candidate set; numerical policies adapt configurations from feedback diagnostics\. LLM\-guided policies read the task and model description, error statistics, and editing history\. They use two proposal stages per round\. Each stage fits and validates the proposed plan alongside shared numerical configurations\. The second stage receives the completed evaluations and revises the plan within its allowed location scope\. Thus, the measured effect of one proposal becomes evidence for the next\.

### 3\.4Native Weight Optimization

An editing plan must produce a correction the original model can execute\. Letz∈ℝdMz\\in\\mathbb\{R\}^\{d\_\{M\}\}represent normalized changes at the selected coordinates, and letDMD\_\{M\}map them into native parameter space using block scales derived fromW0W\_\{0\}\. For regression, writeqM​\(z,x\)q\_\{M\}\(z;x\)for the normalized prediction used during fitting\. The editing objective is

ℒM,h​\(z\)\\displaystyle\\mathcal\{L\}\_\{M,h\}\(z\)=∑i∈Ωtai​ℓ​\(\[qM​\(z,Xt\)\]i,y~i\)\\displaystyle=\\sum\_\{i\\in\\Omega\_\{t\}\}a\_\{i\}\\,\\ell\\\!\\left\(\[q\_\{M\}\(z;X\_\{t\}\)\]\_\{i\},\\widetilde\{y\}\_\{i\}\\right\)\(2\)\+γ​cM​‖z‖22\\displaystyle\+\\gamma c\_\{M\}\\\|z\\\|\_\{2\}^\{2\}\+λ∑j∈ΩRbj\[qM\(z;XR\)−qM\(0;XR\)\]j2\.\\displaystyle\+\\lambda\\sum\_\{j\\in\\Omega\_\{R\}\}b\_\{j\}\\left\[q\_\{M\}\(z;X\_\{R\}\)\-q\_\{M\}\(0;X\_\{R\}\)\\right\]\_\{j\}^\{2\}\.Here,Ωt\\Omega\_\{t\}andΩR\\Omega\_\{R\}index valid fitting and reference outputs,y~\\widetilde\{y\}denotes normalized targets, andbjb\_\{j\}are normalized weights on unlabeled reference inputsXRX\_\{R\}\. The terms fit feedback, regularize displacement, and preserve reference predictions\[[49](https://arxiv.org/html/2611.23718#bib.bib49)\]\. The fixed ridge scalecMc\_\{M\}is the setup pool’s mean squared sensitivity for local fitting, and1/dM1/d\_\{M\}for nonlinear fitting\.

We instantiateqMq\_\{M\}either as a local linear approximation atW0W\_\{0\}or as the nonlinear predictorf~W0\+DM​z\\widetilde\{f\}\_\{W\_\{0\}\+D\_\{M\}z\}\. The former fits a patch in the selected local response directions; the latter optimizes through the native network using Adam\[[20](https://arxiv.org/html/2611.23718#bib.bib20)\]\. Given the fitted solutionz^M,h\\widehat\{z\}\_\{M,h\}, the candidate is

Wt′​\(M,h\)=W0\+η​DM​z^M,h≡W0\+Δ​Wt​\(M,h\)\.W\_\{t\}^\{\\prime\}\(M,h\)=W\_\{0\}\+\\eta D\_\{M\}\\widehat\{z\}\_\{M,h\}\\equiv W\_\{0\}\+\\Delta W\_\{t\}\(M,h\)\.\(3\)Each fit starts fromW0W\_\{0\}\. An accepted candidate replaces the total deployed patch, with unselected coordinates at their original values\. ChangingMMtherefore changes the available correction directions; changinghhchanges how those directions are fitted to feedback\.

### 3\.5Native Validation and Sequential Feedback

Validation connects a proposed correction to its effect on real predictions\. Internal CV fits each candidate on experimental\-group or temporal folds and evaluates it through the original network\[[32](https://arxiv.org/html/2611.23718#bib.bib32)\]\. Concatenated validation predictions yield the task lossLCV​\(M,h\)L\_\{\\mathrm\{CV\}\}\(M,h\)\. Refitting on all returned feedback gives a deployment candidate subject to

LCV​\(M,h\)\\displaystyle L\_\{\\mathrm\{CV\}\}\(M,h\)<\(1−δ\)​LCV​\(W0\),\\displaystyle<\(1\-\\delta\)L\_\{\\mathrm\{CV\}\}\(W\_\{0\}\),\(4\)LSt​\(Wt′​\(M,h\)\)\\displaystyle L\_\{S\_\{t\}\}\\\!\\left\(W\_\{t\}^\{\\prime\}\(M,h\)\\right\)≤\(1\+ε\)​LSt​\(Wt−1\)\.\\displaystyle\\leq\(1\+\\varepsilon\)L\_\{S\_\{t\}\}\(W\_\{t\-1\}\)\.The thresholds specify the required CV improvement and allowed loss change on accumulated feedback\. Task\-specific feasibility checks also apply\. We deploy the eligible candidate with the lowest CV loss, retainingWt−1W\_\{t\-1\}if none qualifies\. Predictions precede the next outcomes\[[8](https://arxiv.org/html/2611.23718#bib.bib8)\]:

y^t\+1\\displaystyle\\widehat\{y\}\_\{t\+1\}=fWt​\(Xt\+1\),\\displaystyle=f\_\{W\_\{t\}\}\(X\_\{t\+1\}\),\(5\)St\+1\\displaystyle S\_\{t\+1\}=St∪\{\(Xt\+1,yt\+1\)\}\.\\displaystyle=S\_\{t\}\\cup\\\{\(X\_\{t\+1\},y\_\{t\+1\}\)\\\}\.The new observations and completed validation records enter the next proposal, closing the loop between editing decisions and their consequences\. Section[4\.1](https://arxiv.org/html/2611.23718#S4.SS1)specifies the policies and solvers used by each family member\.

## 4Experiments

### 4\.1Experimental Setup

#### Protocol\.

To test whether feedback\-guided editing generalizes, we evaluate 22 tasks with task\-specific pretrained models, metrics, and feedback streams\. Methods receive the same returned observations according to their update schedules, ensuring fair comparisons\. Group\- or time\-based internal CV separates fitting from validation to select deployed models\. Predictions are recorded before subsequent outcomes arrive, preventing hindsight\. DeepSeek and Claude are evaluated separately\. Appendix[A\.3](https://arxiv.org/html/2611.23718#A1.SS3)describes the LLM services and the evidence supplied to them\.

#### Comparisons\.

All methods start from the same task\-specific pretrained predictor, enabling comparisons of feedback\-based updates\. Base keeps the predictor unchanged; Adam\[[20](https://arxiv.org/html/2611.23718#bib.bib20)\]fits a fixed local parameter subset; Memory uses distance\-weighted feedback\-residual correction\[[35](https://arxiv.org/html/2611.23718#bib.bib35)\]; Calib fits output scale and bias\[[13](https://arxiv.org/html/2611.23718#bib.bib13),[14](https://arxiv.org/html/2611.23718#bib.bib14)\]\. HypoLoop uses fixed candidate configurations, HL\-Auto adapts configurations numerically, and HL\-LLM revises them with an LLM\. These three operate within a parameter pool established by an LLM at setup, using local linearized fitting\. HL\-Fixed keeps the first LLM plan while fitting weights; HL\-Once retains the first HypoLoop edit\. HL\-Local and HL\-Global use nonlinear native optimization: the former keeps the setup pool, while the latter reselects blocks from the full inventory\. All seven belong to the HypoLoop family\. Appendix[A\.2](https://arxiv.org/html/2611.23718#A1.SS2)details the feedback controls\.

#### Metrics\.

For each task and service, the strongest valid same\-feedback control among the feedback\-based baselines defines the reference, with minimum errore⋆e^\{\\star\}or maximum AP/F1s⋆s^\{\\star\}\. Relative error reductions are100​\(e⋆−em\)/e⋆100\(e^\{\\star\}\-e\_\{m\}\)/e^\{\\star\}; AP/F1 gains are100​\(sm−s⋆\)100\(s\_\{m\}\-s^\{\\star\}\)percentage points, with AP/F1 expressed as fractions\. Positive entries indicate improvement\. Matched location comparisons report task errors and paired 95% intervals\.

Table 1:Overall performance across scientific domains\.The table compares four baselines and seven HypoLoop variants on 22 tasks, reporting results relative to the strongest valid same\-feedback control\. Positive values indicate relative error reductions \(%\) or AP/F1 gains in percentage points \(pp\)\. Each cell reports DeepSeek \(D\) / Claude \(C\)\. Best and second\-best methods areboldandunderlined, respectively\. Best∗denotes the per\-task family maximum\.DATASETS AND MODELSBASE \+ FEEDBACK CONTROLSHYPOLOOP FAMILY \(OURS\)DomainID / DatasetBase modelMetricBaseAdam\[[20](https://arxiv.org/html/2611.23718#bib.bib20)\]Memory\[[35](https://arxiv.org/html/2611.23718#bib.bib35)\]Calib\[[14](https://arxiv.org/html/2611.23718#bib.bib14)\]HypoLoopHL\-AutoHL\-LLMHL\-FixedHL\-OnceHL\-LocalHL\-GlobalBest∗Relative error reduction \(%\)↑\\uparrowBiologyBIO01IFNγ\\gammaKO\[[12](https://arxiv.org/html/2611.23718#bib.bib12)\]GEARS\[[33](https://arxiv.org/html/2611.23718#bib.bib33)\]MSE\-50\.2/\-54\.2\-11\.8/\-15\.80\.0/0\.0\-48\.1/\-52\.1\+3\.3/\-0\.1\+3\.1/0\.0\+2\.8/\+0\.1\+2\.8/\+0\.1\+0\.5/\-2\.6\-11\.8/\-15\.8\-9\.1/\-16\.0\+3\.3/\+0\.1CHEM01ESOL\[[9](https://arxiv.org/html/2611.23718#bib.bib9)\]Uni\-Mol\[[53](https://arxiv.org/html/2611.23718#bib.bib53)\]RMSE\+4\.7/\+4\.7\-13\.2/\-14\.4\-5\.6/\-5\.60\.0/0\.0\+11\.5/\-21\.9\-18\.0/\-21\.9\-14\.9/\-27\.9\-18\.0/\-21\.9\+4\.7/\+4\.7\-7\.6/\-15\.5\-15\.0/\-7\.6\+11\.5/\+4\.7ChemistryCHEM02Lipophilicity\[[47](https://arxiv.org/html/2611.23718#bib.bib47)\]Uni\-Mol\[[53](https://arxiv.org/html/2611.23718#bib.bib53)\]RMSE0\.0/0\.0\-6\.7/\-6\.7\-5\.9/\-5\.90\.0/0\.0\-21\.6/\-21\.6\+1\.8/\+1\.8\-2\.0/\+0\.8\-2\.9/\-2\.90\.0/0\.0\-9\.2/\-7\.2\-16\.1/\-13\.3\+1\.8/\+1\.8MAT01Exfoliation\[[11](https://arxiv.org/html/2611.23718#bib.bib11)\]CGCNN\[[48](https://arxiv.org/html/2611.23718#bib.bib48)\]MAE\-4\.4/\-4\.40\.0/0\.0\-34\.8/\-34\.8\-0\.4/\-0\.4\-2\.3/\-2\.3\+0\.6/\+0\.6\+0\.5/\+0\.3\-0\.3/\-0\.7\-4\.4/\-4\.40\.0/0\.0\-3\.5/0\.0\+0\.6/\+0\.6MaterialsMAT02Phonon peak\[[11](https://arxiv.org/html/2611.23718#bib.bib11)\]CGCNN\[[48](https://arxiv.org/html/2611.23718#bib.bib48)\]MAE\-1\.1/\-1\.1\-4\.2/\-4\.20\.0/0\.0\-7\.7/\-7\.7\-4\.2/\-4\.2\+3\.1/\+3\.1\+2\.6/\-4\.8\-3\.2/\-4\.8\-4\.2/\-4\.2\-2\.9/\+2\.3\-4\.8/\-11\.1\+3\.1/\+3\.1PHY01Burgers\[[38](https://arxiv.org/html/2611.23718#bib.bib38)\]FNO1d\[[24](https://arxiv.org/html/2611.23718#bib.bib24)\]Rel\. L2\-6\.9/\-6\.9\-10\.4/\-10\.4\-37\.0/\-37\.00\.0/0\.0\+38\.4/\+38\.4\+40\.3/\+40\.3\+32\.6/\+40\.3\+32\.6/\+39\.9\+39\.2/\+39\.2\-14\.3/\-14\.3\+71\.3/\+54\.1\+71\.3/\+54\.1PHY02Advection\[[38](https://arxiv.org/html/2611.23718#bib.bib38)\]FNO1d\[[24](https://arxiv.org/html/2611.23718#bib.bib24)\]Rel\. L2\-1\.2/\-0\.10\.0/0\.0\-0\.9/\-0\.1\-1\.2/\-0\.1\+2\.7/\+20\.1\+12\.8/\+20\.9\+5\.1/\+16\.2\+5\.1/\+16\.2\+1\.8/\+18\.30\.0/0\.0\+24\.7/\+30\.1\+24\.7/\+30\.1PhysicsPHY03Reaction–diff\.\[[38](https://arxiv.org/html/2611.23718#bib.bib38)\]FNO1d\[[24](https://arxiv.org/html/2611.23718#bib.bib24)\]Rel\. L2\-439\.4/\-439\.4\-11\.0/\-10\.0\-9\.2/\-16\.30\.0/0\.0\-11\.9/\+5\.7\-11\.9/\+1\.3\-8\.1/\+5\.2\-11\.9/\+1\.3\-7\.7/\+3\.2\-11\.0/\-9\.9\+1\.6/\-3\.1\+1\.6/\+5\.7ENER01Na\-ion\[[40](https://arxiv.org/html/2611.23718#bib.bib40),[42](https://arxiv.org/html/2611.23718#bib.bib42)\]PBT\-L\[[41](https://arxiv.org/html/2611.23718#bib.bib41)\]MAPE\-2135\.2/\-2135\.20\.0/0\.0\-77\.7/\-77\.7\-28\.5/\-28\.5\+5\.5/\+5\.5\-0\.8/\-0\.8\-0\.8/\-0\.8\-0\.8/\+3\.2\+28\.5/\+28\.5\-4\.9/\-4\.9\-21\.1/\+4\.3\+28\.5/\+28\.5ENER02Bldg\. load\[[27](https://arxiv.org/html/2611.23718#bib.bib27)\]DLinear\[[52](https://arxiv.org/html/2611.23718#bib.bib52)\]MAE\-17\.8/\-17\.80\.0/0\.0\-7\.4/\-7\.4\-17\.8/\-17\.8\+1\.1/\+1\.1\-10\.3/\-10\.3\-2\.9/\+0\.5\-2\.1/\+1\.30\.0/0\.0\-0\.2/\-0\.2\-0\.2/\-0\.2\+1\.1/\+1\.3EnergyENER03Wind power\[[54](https://arxiv.org/html/2611.23718#bib.bib54)\]DLinear\[[52](https://arxiv.org/html/2611.23718#bib.bib52)\]Err\.0\.0/0\.0\-14\.5/\-14\.5\-0\.9/\-0\.90\.0/0\.0\-12\.5/\-12\.5\+1\.6/\+1\.6\-3\.7/\-8\.3\-3\.7/\-8\.3\-12\.5/\-12\.5\-17\.8/\-4\.1\-17\.8/\-4\.1\+1\.6/\+1\.6DEP01Make3D\[[34](https://arxiv.org/html/2611.23718#bib.bib34)\]DAv2\-S\[[50](https://arxiv.org/html/2611.23718#bib.bib50)\]AbsRel\-164\.3/\-164\.3\-8\.3/\-8\.3\-25\.6/\-25\.60\.0/0\.0\-1\.4/\-1\.4\-5\.4/\-5\.4\-0\.2/\+0\.2\-0\.2/\+2\.1\-1\.4/\-1\.4\-8\.7/\-8\.7\+4\.4/\-0\.6\+4\.4/\+2\.1DepthDEP02DIODE\[[45](https://arxiv.org/html/2611.23718#bib.bib45)\]DAv2\-S\[[50](https://arxiv.org/html/2611.23718#bib.bib50)\]AbsRel\-81\.4/\-81\.40\.0/0\.0\-20\.6/\-20\.6\-35\.4/\-35\.4\-1\.9/\-1\.9\+7\.7/\+7\.7\+0\.8/\+10\.60\.0/0\.0\-81\.4/\-81\.4\-0\.2/\+3\.9\-0\.2/\+0\.2\+7\.7/\+10\.6SeismicSEIS01STEAD\[[28](https://arxiv.org/html/2611.23718#bib.bib28)\]PhaseNet\[[56](https://arxiv.org/html/2611.23718#bib.bib56)\]MAE \(s\)\-110\.2/\-110\.2\-63\.5/\-63\.50\.0/0\.0\-110\.2/\-110\.2\-137\.4/\-137\.4\+1\.5/\+1\.5\+1\.5/\+1\.5\+1\.5/\+1\.5\-39\.5/\-39\.5\-39\.5/\-39\.5\+12\.0/\+87\.9\+12\.0/\+87\.9MATH01QP\[[10](https://arxiv.org/html/2611.23718#bib.bib10)\]DC3\[[10](https://arxiv.org/html/2611.23718#bib.bib10)\]Obj\. gap\-46\.2/\-46\.20\.0/0\.0\-10\.6/\-10\.6\-46\.2/\-46\.2\+0\.4/\+0\.4\+0\.6/\+0\.6\-0\.2/\+2\.0\+0\.6/\+0\.4\-10\.2/\-10\.2\-0\.9/\-0\.9\+8\.9/\+4\.6\+8\.9/\+4\.6Math\.MATH02Nonconvex\[[10](https://arxiv.org/html/2611.23718#bib.bib10)\]DC3\[[10](https://arxiv.org/html/2611.23718#bib.bib10)\]Obj\. gap0\.0/0\.00\.0/0\.00\.0/0\.00\.0/0\.00\.0/0\.0\+17\.3/\+18\.7\+11\.7/0\.0\+11\.7/0\.00\.0/0\.00\.0/0\.0\+14\.7/\+10\.0\+17\.3/\+18\.7TimeseriesTS01Beijing PM2\.5\[[7](https://arxiv.org/html/2611.23718#bib.bib7)\]NLinear\[[52](https://arxiv.org/html/2611.23718#bib.bib52)\]MAE\-1\.6/\-1\.60\.0/0\.0\-1\.1/\-1\.1\-14\.0/\-14\.00\.0/0\.0\-2\.3/\-2\.3\-5\.5/\+2\.0\-2\.6/\+2\.1\-0\.2/\-0\.2\-4\.3/\-4\.3\-4\.3/\-4\.30\.0/\+2\.1AP/F1 gain \(pp\)↑\\uparrowENG01MVTec AD\[[3](https://arxiv.org/html/2611.23718#bib.bib3)\]AnCLIP\+R\[[55](https://arxiv.org/html/2611.23718#bib.bib55)\]Pixel AP\-0\.4/\-0\.40\.0/0\.0\-0\.4/\-0\.4\-0\.4/\-0\.4\+8\.6/\+8\.6\+5\.9/\+5\.9\+8\.6/\+7\.7\+8\.6/\+8\.6\+6\.8/\+6\.8\-0\.1/\-0\.1\-0\.1/\+9\.6\+8\.6/\+9\.6ENG02MVTec LOCO\[[4](https://arxiv.org/html/2611.23718#bib.bib4)\]AnCLIP\+R\[[55](https://arxiv.org/html/2611.23718#bib.bib55)\]Pixel AP\-0\.2/\-0\.20\.0/0\.0\-0\.2/\-0\.2\-0\.2/\-0\.2\+2\.0/\+2\.0\+0\.5/\+0\.5\+0\.1/\+0\.1\+0\.5/\+0\.5\+0\.2/\+0\.2\-0\.2/\-0\.2\-0\.2/\-0\.2\+2\.0/\+2\.0ENG03VisA\[[57](https://arxiv.org/html/2611.23718#bib.bib57)\]AnCLIP\+R\[[55](https://arxiv.org/html/2611.23718#bib.bib55)\]Pixel AP0\.0/0\.0\-0\.4/\-0\.40\.0/0\.00\.0/0\.0\+3\.3/\+3\.3\+5\.9/\+5\.9\+1\.9/\+3\.2\+3\.3/\+3\.3\+1\.0/\+1\.0\+0\.2/\+0\.2\+0\.2/\+0\.2\+5\.9/\+5\.9IndustryENG04MPDD\[[18](https://arxiv.org/html/2611.23718#bib.bib18)\]AnCLIP\+R\[[55](https://arxiv.org/html/2611.23718#bib.bib55)\]Pixel AP\-0\.1/\-0\.10\.0/0\.0\-0\.1/\-0\.1\-0\.1/\-0\.1\+2\.9/\+2\.9\+5\.5/\+5\.5\+1\.7/\-0\.1\-0\.1/\-0\.1\-0\.1/\-0\.1\-0\.1/\-0\.1\-0\.2/\-0\.1\+5\.5/\+5\.5RemotesensingRS01SpaceNet7\[[43](https://arxiv.org/html/2611.23718#bib.bib43)\]ChMamba\[[6](https://arxiv.org/html/2611.23718#bib.bib6)\]F1\-21\.8/\-21\.80\.0/0\.0\-18\.2/\-18\.2\-21\.8/\-21\.8\+3\.7/\+3\.7\+2\.1/\+2\.3\+7\.5/\+2\.3\+7\.9/\+2\.3\-21\.8/\-21\.8\-0\.2/\-0\.2\-0\.7/\+3\.9\+7\.9/\+3\.9

### 4\.2Overall Performance

The HypoLoop family improves predictions across scientific model types\.Table[1](https://arxiv.org/html/2611.23718#S4.T1)presents all four baselines, seven family members, and both services\. Relative to the strongest feedback control, the fixed\-candidate HypoLoop configuration reduces ESOL RMSE by11\.5%11\.5\\%under DeepSeek; HL\-Auto improves VisA pixel AP by5\.95\.9percentage points under both services\. HL\-Global reduces Burgers error by71\.34%71\.34\\%/54\.12%54\.12\\%and advection error by24\.72%24\.72\\%/30\.11%30\.11\\%under DeepSeek/Claude\. On STEAD, it lowers arrival\-time MAE from 0\.6803 s to 0\.5984 s and 0\.0822 s\. These results motivate testing how the available editing budget is allocated\.

HL\-LLM improves over HL\-Fixed on DIODE, phonon peaks, and reaction–diffusion\. Both keep fitting new feedback; HL\-LLM also revises its plan\. We examine location allocation first, then the fitting rules that turn observed errors into a patch\.

\(a\)Burgers\(b\)Constrained QP

\(c\)Native locations across feedback rounds
Figure 3:Allocating the same parameter budget to different locations\.\(a,b\) Dynamic and fixed locations share the How proposal, fitting procedure, and acceptance rule\. Both continue fitting with new feedback\. Brackets show paired95%95\\%confidence intervals for error reduction; the QP axis is truncated with breaks\. \(c\) Model paths show fixed scopes \(gray\) and final dynamic scopes \(purple\), with an overlapping QP block\. Each service’s trajectory shows selected blocks before B1, B2, and E, with matched budgets\. A/B denote distinct coordinate slices within a layer\. Appendix[C](https://arxiv.org/html/2611.23718#A3)details the full model structures and native\-tensor changes\.\(a\)DIODE
Weighting only\(b\)DIODE
Claude\(c\)Phonon peak
DeepSeek\(d\)Reaction–diffusion
Claude
Figure 4:From error evidence to an executable fitting objective\.\(a\) At the same 33 editable coordinates, positive\-residual weighting lowers DIODE internal CV AbsRel by13\.35%13\.35\\%relative to equal weighting; reversing its direction raises the error\. Other fitting settings remain fixed\. \(b–d\) Both arms continue fitting on new feedback\. Revising the complete editing plan lowers final error by10\.59%10\.59\\%,5\.61%5\.61\\%, and3\.95%3\.95\\%on DIODE, phonon peaks, and reaction–diffusion relative to keeping the initial plan fixed\. Panels \(b–d\) use truncated axes with breaks; labels retain the full error values\.
### 4\.3Where to Edit: Reallocating a Fixed Parameter Budget

Feedback\-guided relocation reduces Burgers error by58\.80%58\.80\\%and47\.72%47\.72\\%while keeping the editable\-coordinate budget fixed\.Figure[3](https://arxiv.org/html/2611.23718#S4.F3)\(a,b\) compares dynamic and fixed editable locations with a shared How proposal, numerical fitting procedure, and acceptance rule\. Both arms continue fitting weights as feedback arrives\. Burgers relativeL2L\_\{2\}error decreases from 0\.040194 to 0\.016559 under DeepSeek and from 0\.030975 to 0\.016195 under Claude\. Constrained QP yields reductions of6\.11%6\.11\\%and5\.31%5\.31\\%, respectively\. The figure reports paired95%95\\%intervals\. Editable\-coordinate budgets are 7,617/8,192 for Burgers and 8,192/8,100 for QP under DeepSeek/Claude\.

The execution traces reveal concrete relocations within the original networks\.In Burgers, the fixed DeepSeek scope spansconv3,fc1, andfc2; dynamic localization selects a block inconv0\. It retains the patch for the next batch before shifting the block\. Claude also selectsconv0, then retains and refits that location\. In QP, the plan moves from a mixed\-layer scope to a block innet\.4, with service\-dependent timing \(Figure[3](https://arxiv.org/html/2611.23718#S4.F3)\(c\)\)\. Selected coordinates specify the budget; changed values record the patch relative toW0W\_\{0\}\. The final DeepSeek Burgers edit selects 7,617 coordinates and changes 7,299 values\. Appendix[C](https://arxiv.org/html/2611.23718#A3)shows the complete model structures and all native\-tensor changes\. We next fix locations and vary the fitting objective\.

\(a\)DIODE \(DeepSeek\)RGB input![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/input.png)Target: depth![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/target.png)Target error: 0![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/target_error.png)Depth \(m\), log scale![Refer to caption](https://arxiv.org/html/2611.23718v1/depth80.png)Pixel AbsRel![Refer to caption](https://arxiv.org/html/2611.23718v1/error.png)ControlsHypoLoop familyPredictionErrorAbsRel↓Base![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__Base.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__Base.png)0\.407Adam![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__Adam.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__Adam.png)0\.4605Memory![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__Memory.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__Memory.png)0\.4333Calib![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__Calib.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__Calib.png)0\.4264HL\-Global![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__HL-Global.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__HL-Global.png)0\.2425HL\-Fixed![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__HL-LLM1.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__HL-LLM1.png)0\.3375HL\-LLM![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__HL-LLM.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__HL-LLM.png)0\.3476HL\-Auto![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/prediction__HL-Auto.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP05_c7eb43d28d1d6946c4526f34__deepseek/error__HL-Auto.png)0\.3718

\(b\)Make3D \(DeepSeek\)RGB input![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/input.png)Target: depth![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/target.png)Target error: 0![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/target_error.png)Depth \(m\), log scale![Refer to caption](https://arxiv.org/html/2611.23718v1/depth70.png)Pixel AbsRel![Refer to caption](https://arxiv.org/html/2611.23718v1/error.png)ControlsHypoLoop familyPredictionErrorAbsRel↓Base![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Base.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Base.png)0\.4812Adam![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Adam.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Adam.png)0\.132Memory![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Memory.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Memory.png)0\.1285Calib![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Calib.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Calib.png)0\.1555HL\-LLM![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HL-LLM.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HL-LLM.png)0\.07843HL\-Fixed![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HL-LLM.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HL-LLM.png)0\.07843HypoLoop![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HypoLoop.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HypoLoop.png)0\.08957HL\-Once![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HypoLoop.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HypoLoop.png)0\.08957

Figure 5:Visual depth correction \(DeepSeek\)\.Prediction/error pairs share scales within each case\. Target error is the zero reference\. Image AbsRel falls \(a\) from 0\.4070 to 0\.2425 with HL\-Global, and \(b\) from 0\.1285 to 0\.0784 with HL\-LLM\. Gray denotes invalid pixels\. Tables rank all eight methods jointly: best in bold, second\-best underlined\.Earlier image![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/input.png)Later image![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/second.png)Target: mask![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/target.png)Target error: 0![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/target_error.png)Target changePredicted changeFalse positiveFalse negativeCorrectControlsHypoLoop familyPredictionErrorF1↑Base![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__Base.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__Base.png)0Adam![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__Adam.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__Adam.png)0\.5779Memory![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__Memory.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__Memory.png)0\.3328Calib![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__Base.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__Base.png)0HL\-Global![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__HL-Global.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__HL-Global.png)0\.7637HL\-Local![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__HL-Local.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__HL-Local.png)0\.5797HypoLoop![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__HypoLoop.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__HypoLoop.png)0\.517HL\-Auto![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/prediction__HL-Auto.png)![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/RS04_cb2620f8808a011fd7bcac47__claude/error__HL-Auto.png)0\.3962

Figure 6:Feedback\-guided spatial correction on SpaceNet7 \(Claude\)\.The full region is shown for four controls and four HypoLoop configurations\. Each method pairs prediction and FP/FN errors; target error is the zero reference\. Region F1 rises from 0\.5779 \(Adam\) to 0\.7637 \(HL\-Global\); full\-split F1 rises from 0\.2507 to 0\.2899\. Green marks predicted building changes for every method; purple is reserved for HypoLoop method names\. Tables rank all eight methods jointly\.
### 4\.4How to Edit: Revising Fitting Rules from Feedback

#### From an error pattern to a fitting rule\.

DIODE feedback shows systematic depth overestimation: 12 images have a mean signed error of\+1\.435\+1\.435m\. The accepted proposal therefore emphasizes positive residuals with

g⁡\(r\)\\displaystyle g\(r\)=clip⁡\(e2​r,0\.2,5\),\\displaystyle=\\operatorname\{clip\}\\\!\\left\(e^\{2r\},0\.2,5\\right\),\(6\)r\\displaystyle r=\(fW0​\(x\)−y\)/s\.\\displaystyle=\\big\(f\_\{W\_\{0\}\}\(x\)\-y\\big\)/s\.Here,ssis the fixed task scale\. These weights focus fitting on overestimated depths\. For phonon peaks, the accepted plan attenuates large residuals throughg⁡\(r\)=exp⁡\(−tanh⁡\(\|r\|\)\)g\(r\)=\\exp\(\-\\tanh\(\|r\|\)\)\. Different error patterns therefore lead to different executable fitting rules\.

#### Validating the proposed direction\.

Positive\-residual weighting reduces DIODE internal CV AbsRel by13\.35%13\.35\\%at the same 33\-coordinate editable set\.Holding smooth MAE, ridge coefficient 0\.01, and zero preservation penalty fixed, uniform weighting obtains 0\.894701 and positive\-residual weighting obtains 0\.775221\. Reversing the residual emphasis raises the error to 1\.437018 \(Figure[4](https://arxiv.org/html/2611.23718#S4.F4)\(a\)\)\. This single\-factor comparison verifies that the direction identified from feedback matters to the fitted edit\.

#### Revising the complete editing plan\.

Both HL\-LLM and HL\-Fixed continue fitting weights on new feedback; only HL\-LLM revises its plan \(Figure[4](https://arxiv.org/html/2611.23718#S4.F4)\(b–d\)\)\. Revision reduces DIODE AbsRel from 0\.418085 to 0\.373803 under Claude \(10\.59%10\.59\\%\), phonon\-peak MAE from 59\.452 to 56\.117 cm\-1under DeepSeek \(5\.61%5\.61\\%\), and reaction–diffusion relativeL2L\_\{2\}error from 0\.119770 to 0\.115037 under Claude \(3\.95%3\.95\\%\)\. Together, the controlled weighting study and sequential comparisons connect an error\-based judgment to its immediate fit and later predictions\.

### 4\.5DIODE and Make3D Depth Correction

Figure[5](https://arxiv.org/html/2611.23718#S4.F5)compares indoor DIODE and outdoor Make3D under DeepSeek\. On DIODE, HL\-Global lowers image AbsRel from 0\.4070 for Base to 0\.2425 \(40\.41%40\.41\\%\)\. On Make3D, HL\-LLM lowers AbsRel from 0\.1285 for Memory to 0\.0784 \(38\.98%38\.98\\%\)\. Its first accepted 33\-value patch uses 21 feedback images and remains deployed in later rounds\. The depth and error maps show where accepted weight edits reduce prediction errors\.

### 4\.6SpaceNet7: Closing the Loop with Spatial Feedback

Figure[6](https://arxiv.org/html/2611.23718#S4.F6)shows the full SpaceNet7 comparison\. With 8, 12, then 16 feedback regions, HL\-Global revisits native coordinates in fusion, smoothing, and prediction layers\. Foreground\-weighted binary cross\-entropy,w⁡\(y\)=1\+9​yw\(y\)=1\+9y, prioritizes changed buildings\. The first patch changes 7,554 values; the next changes 6,914 and lowers regularization from10−210^\{\-2\}to10−410^\{\-4\}\. The final round retains this patch\. Full\-split F1 rises from 0\.2507 for Adam to 0\.2899 \(\+3\.93 points\); the displayed region improves from 0\.5779 to 0\.7637 \(\+18\.58 points\), with FP/FN maps locating the corrections\.

#### Recovering missed changes\.

The region in Figure[6](https://arxiv.org/html/2611.23718#S4.F6)contains 3,266 changed pixels among 36,864 valid pixels\. At the shared zero\-logit threshold, Adam recovers 1,618 changed pixels and produces 716 false positives; HL\-Global recovers 2,459 changed pixels with 715 false positives\. The accepted edit recovers 841 additional changed pixels while keeping false positives almost unchanged\. Recall rises from49\.54%49\.54\\%to75\.29%75\.29\\%, and precision from69\.32%69\.32\\%to77\.47%77\.47\\%\. The error maps locate this recovery in the blue missed\-change regions\. Changed buildings occupy just8\.86%8\.86\\%of the image, so a background\-only prediction already attains91\.14%91\.14\\%pixel accuracy\. F1 and the FP/FN breakdown expose the foreground correction encouraged by the weighted objective and realized by the deployed native weights\.

## 5Conclusion

HypoLoop connects scientific feedback to two decisions in model updating: where to allocate an editing budget and how prediction errors should drive the correction\. Its method family combines proposal policies with numerical weight editing and native validation\. Across 22 tasks, matched\-budget studies show the effect of location choice, while controlled weighting and sequential\-plan comparisons show the effect of fitting\-rule revision\. Building\-change and depth cases trace accepted patches to changes in real predictions\. Experimental evidence can guide both the parameters being updated and the problem used to compute their update\.

## LLM Usage Statement

OpenAI Codex, using GPT\-6 Astra and GPT\-6\.1 Sol, assisted with code development and manuscript language editing\. DeepSeek and Claude served as experimental proposal models, generating and revising weight\-editing plans based on model information, prediction errors, and validation history, following the procedures described in Section[3](https://arxiv.org/html/2611.23718#S3)\. The authors reviewed and verified the experimental results and remain responsible for the experimental design, numerical optimization, and all scientific claims\.

## References

- \[1\]Marcin Andrychowicz, Misha Denil, Sergio Gómez, Matthew W\. Hoffman, David Pfau, Tom Schaul, Brendan Shillingford, and Nando de Freitas\.Learning to learn by gradient descent by gradient descent\.In*Advances in Neural Information Processing Systems*, volume 29, 2016\.[https://papers\.nips\.cc/paper/2016/hash/fb87582825f9d28a8d42c5e5e5e8b23d\-Abstract\.html](https://papers.nips.cc/paper/2016/hash/fb87582825f9d28a8d42c5e5e5e8b23d-Abstract.html)\.
- \[2\]Jonathan T\. Barron\. A General and Adaptive Robust Loss Function\.*Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition*, pages 4331–4339, 2019\.[https://openaccess\.thecvf\.com/content\_CVPR\_2019/html/Barron\_A\_General\_and\_Adaptive\_Robust\_Loss\_Function\_CVPR\_2019\_paper\.html](https://openaccess.thecvf.com/content_CVPR_2019/html/Barron_A_General_and_Adaptive_Robust_Loss_Function_CVPR_2019_paper.html)\.
- \[3\]Paul Bergmann, Michael Fauser, David Sattlegger, and Carsten Steger\. MVTec AD—A Comprehensive Real\-World Dataset for Unsupervised Anomaly Detection\.*CVPR, pages 9592–9600, 2019\.*[https://openaccess\.thecvf\.com/content\_CVPR\_2019/html/Bergmann\_MVTec\_AD\_\-\-\_A\_Comprehensive\_Real\-World\_Dataset\_for\_Unsupervised\_Anomaly\_CVPR\_2019\_paper\.html](https://openaccess.thecvf.com/content_CVPR_2019/html/Bergmann_MVTec_AD_--_A_Comprehensive_Real-World_Dataset_for_Unsupervised_Anomaly_CVPR_2019_paper.html)\.
- \[4\]Paul Bergmann, Kilian Batzner, Michael Fauser, David Sattlegger, and Carsten Steger\. Beyond Dents and Scratches: Logical Constraints in Unsupervised Anomaly Detection and Localization\.*International Journal of Computer Vision, 2022\.*[https://doi\.org/10\.1007/s11263\-022\-01578\-9](https://doi.org/10.1007/s11263-022-01578-9)\.
- \[5\]Rafael Bischof and Michael A\. Kraus\.Multi\-Objective Loss Balancing for Physics\-Informed Deep Learning\.*Computer Methods in Applied Mechanics and Engineering*, 439:117914, 2025\.[https://doi\.org/10\.1016/j\.cma\.2025\.117914](https://doi.org/10.1016/j.cma.2025.117914)\.
- \[6\]Hongruixuan Chen, Jian Song, Chengxi Han, Junshi Xia, and Naoto Yokoya\. ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Model\.*IEEE Transactions on Geoscience and Remote Sensing, 62:1–20, 2024\.*[https://doi\.org/10\.1109/TGRS\.2024\.3417253](https://doi.org/10.1109/TGRS.2024.3417253)\.
- \[7\]Song Chen\. Beijing Multi\-Site Air Quality\.*UCI Machine Learning Repository dataset, 2017\.*[https://doi\.org/10\.24432/C5RK5G](https://doi.org/10.24432/C5RK5G)\.
- \[8\]A\. P\. Dawid\. Present Position and Potential Developments: Some Personal Views: Statistical Theory: The Prequential Approach\.*Journal of the Royal Statistical Society: Series A \(General\)*, 147\(2\):278–290, 1984\.[https://doi\.org/10\.2307/2981683](https://doi.org/10.2307/2981683)\.
- \[9\]John S\. Delaney\. ESOL: Estimating Aqueous Solubility Directly from Molecular Structure\.*Journal of Chemical Information and Computer Sciences, 44\(3\):1000–1005, 2004\.*[https://doi\.org/10\.1021/ci034243x](https://doi.org/10.1021/ci034243x)\.
- \[10\]Priya L\. Donti, David Rolnick, and J\. Zico Kolter\. DC3: A learning method for optimization with hard constraints\.*ICLR, 2021\.*[https://openreview\.net/forum?id=V1ZHVxJ6dSS](https://openreview.net/forum?id=V1ZHVxJ6dSS)\.
- \[11\]Alexander Dunn, Qi Wang, Alex Ganose, Daniel Dopp, and Anubhav Jain\. Benchmarking materials property prediction methods: The Matbench test set and Automatminer reference algorithm\.*npj Computational Materials, 6:138, 2020\.*[https://doi\.org/10\.1038/s41524\-020\-00406\-3](https://doi.org/10.1038/s41524-020-00406-3)\.
- \[12\]Chris J\. Frangieh et al\. Multimodal pooled Perturb\-CITE\-seq screens in patient models define mechanisms of cancer immune evasion\.*Nature Genetics, 53:332–341, 2021\.*[https://doi\.org/10\.1038/s41588\-021\-00779\-1](https://doi.org/10.1038/s41588-021-00779-1)\.
- \[13\]Harry R\. Glahn and Dale A\. Lowry\.The Use of Model Output Statistics \(MOS\) in Objective Weather Forecasting\.*Journal of Applied Meteorology*, 11\(8\):1203–1211, 1972\.[https://journals\.ametsoc\.org/view/journals/apme/11/8/1520\-0450\_1972\_011\_1203\_tuomos\_2\_0\_co\_2\.xml](https://journals.ametsoc.org/view/journals/apme/11/8/1520-0450_1972_011_1203_tuomos_2_0_co_2.xml)\.
- \[14\]Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q\. Weinberger\.On Calibration of Modern Neural Networks\.In*Proceedings of the 34th International Conference on Machine Learning*, volume 70 of*Proceedings of Machine Learning Research*, pages 1321–1330, 2017\.[https://proceedings\.mlr\.press/v70/guo17a\.html](https://proceedings.mlr.press/v70/guo17a.html)\.
- \[15\]Joshua E\. Hammond, Tyler A\. Soderstrom, Brian A\. Korgel, and Michael Baldea\.A selective Kalman filtering approach to online neural network updating under system drift\.*Scientific Reports*, 15\(1\):43577, 2025\.[https://doi\.org/10\.1038/s41598\-025\-24558\-8](https://doi.org/10.1038/s41598-025-24558-8)\.
- \[16\]Junru Hu, Cheng Tang, Wei Li, Hongze Zhu, Chun\-Mei Feng, Qi Zhang, Yirong Chen, and Ming Hu\. Exploring Weight\-Space Programming: Capabilities, Generalization, and Limitations\.*arXiv:2611\.09382*, 2026\.[https://arxiv\.org/abs/2611\.09382](https://arxiv.org/abs/2611.09382)\.
- \[17\]Chanhwi Jeong, Inhwan Bae, Jin\-Hwi Park, and Hae\-Gon Jeon\.Test\-Time Prompt Tuning for Zero\-Shot Depth Completion\.In*Proceedings of the IEEE/CVF International Conference on Computer Vision*, pages 9443–9454, 2025\.[https://openaccess\.thecvf\.com/content/ICCV2025/html/Jeong\_Test\-Time\_Prompt\_Tuning\_for\_Zero\-Shot\_Depth\_Completion\_ICCV\_2025\_paper\.html](https://openaccess.thecvf.com/content/ICCV2025/html/Jeong_Test-Time_Prompt_Tuning_for_Zero-Shot_Depth_Completion_ICCV_2025_paper.html)\.
- \[18\]Stepan Jezek, Martin Jonak, Radim Burget, Pavel Dvorak, and Milos Skotak\. Deep learning\-based defect detection of metal parts: Evaluating current methods in complex conditions\.*ICUMT, pages 66–71, 2021\.*[https://doi\.org/10\.1109/ICUMT54235\.2021\.9631567](https://doi.org/10.1109/ICUMT54235.2021.9631567)\.
- \[19\]Sanchit Kabra, Nikhil Abhyankar, Saaketh Desai, Prasad P\. Iyer, and Chandan K\. Reddy\. LLM\-AutoSciLab: Closed\-Loop Scientific Discovery via Active Experimentation with LLMs\.*arXiv:2605\.24043*, 2026\.[https://arxiv\.org/abs/2605\.24043](https://arxiv.org/abs/2605.24043)\.
- \[20\]Diederik P\. Kingma and Jimmy Ba\. Adam: A Method for Stochastic Optimization\.*ICLR, 2015\.*[https://arxiv\.org/abs/1412\.6980](https://arxiv.org/abs/1412.6980)\.
- \[21\]Yoonho Lee, Annie S\. Chen, Fahim Tajwar, Ananya Kumar, Huaxiu Yao, Percy Liang, and Chelsea Finn\.Surgical Fine\-Tuning Improves Adaptation to Distribution Shifts\.In*International Conference on Learning Representations*, 2023\.[https://openreview\.net/forum?id=APuPRxjHvZ](https://openreview.net/forum?id=APuPRxjHvZ)\.
- \[22\]Mengran Li, Bo Li, Weijing Zhao, Chengyang Zhang, Boyu Zhang, Jinfeng Xu, Zelin Zang, Victor C\. M\. Leung, and Stan Z\. Li\.WeightLoop: Weight\-Space Programming with Experimental Feedback\.*arXiv preprint arXiv:2611\.07319*, 2026\.[https://arxiv\.org/abs/2611\.07319](https://arxiv.org/abs/2611.07319)\.
- \[23\]Xingwang Li, Fei Teng, Cong Zhou, and Qiang Duan\.Beyond Uniform Updates: Drift Pattern Aware Online Time Series Forecasting Under Delayed Feedback\.In*Proceedings of the Thirty\-Fifth International Joint Conference on Artificial Intelligence*, pages 4518–4526, 2026\.[https://ijcai\.org/proceedings/2026/503](https://ijcai.org/proceedings/2026/503)\.
- \[24\]Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar\. Fourier Neural Operator for Parametric Partial Differential Equations\.*ICLR, 2021\.*[https://openreview\.net/forum?id=c8P9NQVtmnO](https://openreview.net/forum?id=c8P9NQVtmnO)\.
- \[25\]Chris Lu, Samuel Holt, Claudio Fanconi, Alex J\. Chan, Jakob Foerster, Mihaela van der Schaar, and Robert Tjarko Lange\.Discovering Preference Optimization Algorithms with and for Large Language Models\.In*Advances in Neural Information Processing Systems*, volume 37, 2024\.[https://proceedings\.neurips\.cc/paper\_files/paper/2024/hash/9d88b87b31986f8293bb0067a841579e\-Abstract\-Conference\.html](https://proceedings.neurips.cc/paper_files/paper/2024/hash/9d88b87b31986f8293bb0067a841579e-Abstract-Conference.html)\.
- \[26\]Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov\.Locating and Editing Factual Associations in GPT\.In*Advances in Neural Information Processing Systems*, volume 35, 2022\.[https://papers\.neurips\.cc/paper\_files/paper/2022/hash/6f1d43d5a82a37e89b0665b33bf3a182\-Abstract\-Conference\.html](https://papers.neurips.cc/paper_files/paper/2022/hash/6f1d43d5a82a37e89b0665b33bf3a182-Abstract-Conference.html)\.
- \[27\]Clayton Miller et al\. The Building Data Genome Project 2, energy meter data from the ASHRAE Great Energy Predictor III competition\.*Scientific Data, 7:368, 2020\.*[https://doi\.org/10\.1038/s41597\-020\-00712\-x](https://doi.org/10.1038/s41597-020-00712-x)\.
- \[28\]S\. Mostafa Mousavi, Yixiao Sheng, Weiqiang Zhu, and Gregory C\. Beroza\. STanford EArthquake Dataset \(STEAD\): A Global Data Set of Seismic Signals for AI\.*IEEE Access, 2019\.*[https://doi\.org/10\.1109/ACCESS\.2019\.2947848](https://doi.org/10.1109/ACCESS.2019.2947848)\.
- \[29\]Hyoungseob Park, Anjali Gupta, and Alex Wong\.Test\-Time Adaptation for Depth Completion\.In*Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition*, pages 20519–20529, 2024\.[https://openaccess\.thecvf\.com/content/CVPR2024/html/Park\_Test\-Time\_Adaptation\_for\_Depth\_Completion\_CVPR\_2024\_paper\.html](https://openaccess.thecvf.com/content/CVPR2024/html/Park_Test-Time_Adaptation_for_Depth_Completion_CVPR_2024_paper.html)\.
- \[30\]Sylvestre\-Alvise Rebuffi, Hakan Bilen, and Andrea Vedaldi\. Learning multiple visual domains with residual adapters\.*Advances in Neural Information Processing Systems*, volume 30, 2017\.[https://proceedings\.neurips\.cc/paper\_files/paper/2017/hash/e7b24b112a44fdd9ee93bdf998c6ca0e\-Abstract\.html](https://proceedings.neurips.cc/paper_files/paper/2017/hash/e7b24b112a44fdd9ee93bdf998c6ca0e-Abstract.html)\.
- \[31\]Mengye Ren, Wenyuan Zeng, Bin Yang, and Raquel Urtasun\.Learning to Reweight Examples for Robust Deep Learning\.In*Proceedings of the 35th International Conference on Machine Learning*, volume 80 of*Proceedings of Machine Learning Research*, pages 4334–4343, 2018\.[https://proceedings\.mlr\.press/v80/ren18a\.html](https://proceedings.mlr.press/v80/ren18a.html)\.
- \[32\]David R\. Roberts, Volker Bahn, Simone Ciuti, Mark S\. Boyce, Jane Elith, Gurutzeta Guillera\-Arroita, Severin Hauenstein, José J\. Lahoz\-Monfort, Boris Schröder, Wilfried Thuiller, David I\. Warton, Brendan A\. Wintle, Florian Hartig, and Carsten F\. Dormann\. Cross\-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure\.*Ecography*, 40\(8\):913–929, 2017\.[https://doi\.org/10\.1111/ecog\.02881](https://doi.org/10.1111/ecog.02881)\.
- \[33\]Yusuf Roohani, Kexin Huang, and Jure Leskovec\. Predicting transcriptional outcomes of novel multigene perturbations with GEARS\.*Nature Biotechnology, 42:927–935, 2024 \(published online in 2023\)\.*[https://doi\.org/10\.1038/s41587\-023\-01905\-6](https://doi.org/10.1038/s41587-023-01905-6)\.
- \[34\]Ashutosh Saxena, Min Sun, and Andrew Y\. Ng\. Make3D: Learning 3D Scene Structure from a Single Still Image\.*IEEE Transactions on Pattern Analysis and Machine Intelligence, 31\(5\):824–840, 2009\.*[https://doi\.org/10\.1109/TPAMI\.2008\.132](https://doi.org/10.1109/TPAMI.2008.132)\.
- \[35\]Donald Shepard\.A two\-dimensional interpolation function for irregularly\-spaced data\.In*Proceedings of the 1968 23rd ACM National Conference*, pages 517–524, 1968\.[https://doi\.org/10\.1145/800186\.810616](https://doi.org/10.1145/800186.810616)\.
- \[36\]Jeongju Sohn, Sungmin Kang, and Shin Yoo\.Arachne: Search\-Based Repair of Deep Neural Networks\.*ACM Transactions on Software Engineering and Methodology*, 32\(4\):1–26, 2023\.[https://doi\.org/10\.1145/3563210](https://doi.org/10.1145/3563210)\.
- \[37\]Yu Sun, Xiaolong Wang, Zhuang Liu, John Miller, Alexei Efros, and Moritz Hardt\.Test\-Time Training with Self\-Supervision for Generalization under Distribution Shifts\.In*Proceedings of the 37th International Conference on Machine Learning*, volume 119 of*Proceedings of Machine Learning Research*, pages 9229–9248, 2020\.[https://proceedings\.mlr\.press/v119/sun20b\.html](https://proceedings.mlr.press/v119/sun20b.html)\.
- \[38\]Makoto Takamoto, Timothy Praditia, Raphael Leiteritz, Daniel MacKinlay, Francesco Alesiani, Dirk Pflüger, and Mathias Niepert\. PDEBench: An Extensive Benchmark for Scientific Machine Learning\.*NeurIPS Datasets and Benchmarks, 2022\.*[https://proceedings\.neurips\.cc/paper\_files/paper/2022/hash/0a9747136d411fb83f0cf81820d44afb\-Abstract\-Datasets\_and\_Benchmarks\.html](https://proceedings.neurips.cc/paper_files/paper/2022/hash/0a9747136d411fb83f0cf81820d44afb-Abstract-Datasets_and_Benchmarks.html)\.
- \[39\]Rikiya Takehi, Jayden Teoh, Alex Zhang, and Omar Khattab\. Sparks of Weight\-Space Programming: LLMs can natively read & write neural network weights\.*Author blog*, November 2, 2026\.[https://rikiyat\.github\.io/blog/weight\-space\-programming/](https://rikiyat.github.io/blog/weight-space-programming/)\.
- \[40\]Ruifeng Tan, Weixiang Hong, Jiayue Tang, Xibin Lu, Ruijun Ma, Xiang Zheng, Jia Li, Jiaqiang Huang, and Tong\-Yi Zhang\. BatteryLife: A Comprehensive Dataset and Benchmark for Battery Life Prediction\.*Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V\.2, pages 5789–5800, 2025\.*[https://doi\.org/10\.1145/3711896\.3737372](https://doi.org/10.1145/3711896.3737372)\.
- \[41\]Ruifeng Tan, Weixiang Hong, Jia Li, Jiaqiang Huang, and Tong\-Yi Zhang\. Pretrained battery transformer \(PBT\): A foundation model for battery life prediction\.*Energy & Environmental Science, 2026\.*[https://doi\.org/10\.1039/D6EE03446B](https://doi.org/10.1039/D6EE03446B)\.
- \[42\]Ruifeng Tan et al\. BatteryLife\_Processed, version v9\.*Zenodo dataset, 2025\. Includes the Na\-ion subset\.*[https://doi\.org/10\.5281/zenodo\.17958489](https://doi.org/10.5281/zenodo.17958489)\.
- \[43\]Adam Van Etten, Daniel Hogan, Jesus Martinez Manso, Jacob Shermeyer, Nicholas Weir, and Ryan Lewis\. The Multi\-Temporal Urban Development SpaceNet Dataset\.*CVPR, pages 6398–6407, 2021\.*[https://openaccess\.thecvf\.com/content/CVPR2021/html/Van\_Etten\_The\_Multi\-Temporal\_Urban\_Development\_SpaceNet\_Dataset\_CVPR\_2021\_paper\.html](https://openaccess.thecvf.com/content/CVPR2021/html/Van_Etten_The_Multi-Temporal_Urban_Development_SpaceNet_Dataset_CVPR_2021_paper.html)\.
- \[44\]Dara Varam, Taraneh Aminosharieh Najafi, and David Atienza\. Mixed Signals: Weight\-Space Programming for EEG and ECG\.*arXiv:2611\.13758*, 2026\.[https://arxiv\.org/abs/2611\.13758](https://arxiv.org/abs/2611.13758)\.
- \[45\]Igor Vasiljevic et al\. DIODE: A Dense Indoor and Outdoor DEpth Dataset\.*arXiv:1908\.00463, 2019\.*[https://arxiv\.org/abs/1908\.00463](https://arxiv.org/abs/1908.00463)\.
- \[46\]Zifeng Wang, Zheng Zhan, Yifan Gong, Geng Yuan, Wei Niu, Tong Jian, Bin Ren, Stratis Ioannidis, Yanzhi Wang, and Jennifer Dy\.SparCL: Sparse Continual Learning on the Edge\.In*Advances in Neural Information Processing Systems*, volume 35, 2022\.[https://proceedings\.neurips\.cc/paper\_files/paper/2022/hash/80133d0f6eccaace15508f91e3c5a93c\-Abstract\-Conference\.html](https://proceedings.neurips.cc/paper_files/paper/2022/hash/80133d0f6eccaace15508f91e3c5a93c-Abstract-Conference.html)\.
- \[47\]Zhenqin Wu et al\. MoleculeNet: A benchmark for molecular machine learning\.*Chemical Science, 9:513–530, 2018\.*[https://doi\.org/10\.1039/C7SC02664A](https://doi.org/10.1039/C7SC02664A)\.
- \[48\]Tian Xie and Jeffrey C\. Grossman\. Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties\.*Physical Review Letters, 120:145301, 2018\.*[https://doi\.org/10\.1103/PhysRevLett\.120\.145301](https://doi.org/10.1103/PhysRevLett.120.145301)\.
- \[49\]Sijie Yan, Yuanjun Xiong, Kaustav Kundu, Shuo Yang, Siqi Deng, Meng Wang, Wei Xia, and Stefano Soatto\.Positive\-Congruent Training: Towards Regression\-Free Model Updates\.In*Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition*, pages 14299–14308, 2021\.[https://openaccess\.thecvf\.com/content/CVPR2021/html/Yan\_Positive\-Congruent\_Training\_Towards\_Regression\-Free\_Model\_Updates\_CVPR\_2021\_paper\.html](https://openaccess.thecvf.com/content/CVPR2021/html/Yan_Positive-Congruent_Training_Towards_Regression-Free_Model_Updates_CVPR_2021_paper.html)\.
- \[50\]Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao\. Depth Anything V2\.*NeurIPS, 2024\.*[https://proceedings\.neurips\.cc/paper\_files/paper/2024/hash/26cfdcd8fe6fd75cc53e92963a656c58\-Abstract\-Conference\.html](https://proceedings.neurips.cc/paper_files/paper/2024/hash/26cfdcd8fe6fd75cc53e92963a656c58-Abstract-Conference.html)\.
- \[51\]Yunqiao Yang, Long\-Kai Huang, Shengzhuang Chen, Kede Ma, and Ying Wei\.Learning Where to Edit Vision Transformers\.In*Advances in Neural Information Processing Systems*, volume 37, 2024\.[https://proceedings\.neurips\.cc/paper\_files/paper/2024/hash/f269520d5f111719dd82b36667997d49\-Abstract\-Conference\.html](https://proceedings.neurips.cc/paper_files/paper/2024/hash/f269520d5f111719dd82b36667997d49-Abstract-Conference.html)\.
- \[52\]Ailing Zeng, Muxi Chen, Lei Zhang, and Qiang Xu\. Are Transformers Effective for Time Series Forecasting?*AAAI, 2023\.*[https://doi\.org/10\.1609/aaai\.v37i9\.26317](https://doi.org/10.1609/aaai.v37i9.26317)\.
- \[53\]Gengmo Zhou, Zhifeng Gao, Qiankun Ding, Hang Zheng, Hongteng Xu, Zhewei Wei, Linfeng Zhang, and Guolin Ke\. Uni\-Mol: A Universal 3D Molecular Representation Learning Framework\.*ICLR, 2023\.*[https://openreview\.net/forum?id=6K2RM6wVqKu](https://openreview.net/forum?id=6K2RM6wVqKu)\.
- \[54\]Jingbo Zhou et al\. SDWPF: A Dataset for Spatial Dynamic Wind Power Forecasting over a Large Turbine Array\.*Scientific Data, 11:649, 2024\.*[https://doi\.org/10\.1038/s41597\-024\-03427\-5](https://doi.org/10.1038/s41597-024-03427-5)\.
- \[55\]Qihang Zhou, Guansong Pang, Yu Tian, Shibo He, and Jiming Chen\. AnomalyCLIP: Object\-agnostic Prompt Learning for Zero\-shot Anomaly Detection\.*ICLR, 2024\.*[https://proceedings\.iclr\.cc/paper\_files/paper/2024/hash/d7b50b8ac2c781a12f26155f48310d8d\-Abstract\-Conference\.html](https://proceedings.iclr.cc/paper_files/paper/2024/hash/d7b50b8ac2c781a12f26155f48310d8d-Abstract-Conference.html)\.
- \[56\]Weiqiang Zhu and Gregory C\. Beroza\. PhaseNet: A deep\-neural\-network\-based seismic arrival\-time picking method\.*Geophysical Journal International, 216\(1\):261–273, 2019\.*[https://doi\.org/10\.1093/gji/ggy423](https://doi.org/10.1093/gji/ggy423)\.
- \[57\]Yang Zou, Jongheon Jeong, Latha Pemula, Dongqing Zhang, and Onkar Dabeer\. SPot\-the\-Difference Self\-Supervised Pre\-training for Anomaly Detection and Segmentation\.*ECCV, 2022\.*[https://www\.ecva\.net/papers/eccv\_2022/papers\_ECCV/html/2149\_ECCV\_2022\_paper\.php](https://www.ecva.net/papers/eccv_2022/papers_ECCV/html/2149_ECCV_2022_paper.php)\.
- \[58\]Anthropic\. Claude Fable 5\.*Claude Platform Documentation*, 2026\.[https://platform\.claude\.com/docs/en/models/fable\-5/overview](https://platform.claude.com/docs/en/models/fable-5/overview)\. Accessed November 17, 2026\.
- \[59\]DeepSeek\. Models & Pricing\.*DeepSeek API Documentation*, 2026\.[https://api\-docs\.deepseek\.com/quick\_start/pricing/](https://api-docs.deepseek.com/quick_start/pricing/)\. Accessed November 17, 2026\.

Supplementary Material

## Appendix AExperimental details

Table 2:Absolute evaluation metrics for the 22 tasks in Table[1](https://arxiv.org/html/2611.23718#S4.T1)\.Each cell reports DeepSeek \(D\) / Claude \(C\)\. Best and second\-best methods areboldandunderlined, respectively\.DATASETS AND METRICSBASE \+ FEEDBACK CONTROLSHYPOLOOP FAMILY \(OURS\)DomainID / DatasetMetricBaseAdamMemoryCalibHypoLoopHL\-AutoHL\-LLMHL\-FixedHL\-OnceHL\-LocalHL\-GlobalError metrics↓\\downarrowBiologyBIO01IFNγ\\gammaKOMSE0\.0372980\.0372980\.0277700\.0280050\.0248370\.0241910\.0367930\.0367930\.0240280\.0242170\.0240580\.0241830\.0241340\.0241760\.0241340\.0241770\.0247110\.0248260\.0277730\.0280080\.0271040\.028058ChemistryCHEM01ESOLRMSE1\.02461\.02461\.21721\.22991\.13481\.13481\.07491\.07490\.95181\.31041\.26881\.31041\.23471\.37531\.26881\.31041\.02461\.02461\.15651\.24181\.23671\.1565CHEM02LipophilicityRMSE0\.93080\.93080\.99330\.99330\.98530\.98530\.93080\.93081\.13221\.13220\.91370\.91370\.94970\.92290\.95800\.95800\.93080\.93081\.01680\.99811\.08031\.0549MaterialsMAT01ExfoliationMAE46\.26146\.26144\.29344\.29359\.71659\.71644\.46044\.46045\.29645\.29644\.03444\.03444\.06744\.14744\.44144\.60146\.26146\.26144\.29944\.29945\.82344\.315MAT02Phonon peakMAE58\.20658\.20660\.03460\.03457\.60057\.60062\.02662\.02660\.00360\.00355\.82555\.82556\.11760\.35559\.45260\.35560\.00360\.00359\.29656\.24760\.38763\.969PhysicsPHY01BurgersRel\. L20\.081570\.081570\.084260\.084260\.104530\.104530\.076320\.076320\.046990\.046990\.045540\.045540\.051410\.045570\.051410\.045870\.046430\.046430\.087240\.087240\.021880\.03502PHY02AdvectionRel\. L20\.0081050\.0081050\.0080050\.0080970\.0080810\.0081040\.0081050\.0081050\.0077880\.0064680\.0069810\.0064020\.0075950\.0067830\.0075930\.0067830\.0078630\.0066110\.0080080\.0080970\.0060260\.005659PHY03Reaction–diff\.Rel\. L20\.65450\.65450\.13470\.13340\.13250\.14110\.12130\.12130\.13580\.11440\.13580\.11980\.13110\.11500\.13580\.11980\.13060\.11750\.13470\.13340\.11940\.1250EnergyENER01Na\-ionMAPE601\.276601\.27626\.90126\.90147\.81047\.81034\.57534\.57525\.42325\.42327\.11827\.11827\.11827\.11827\.11826\.04619\.22319\.22328\.21528\.21532\.58625\.742ENER02Bldg\. loadMAE19\.59819\.59816\.64216\.64217\.86517\.86519\.59819\.59816\.46116\.46118\.35618\.35617\.11916\.55416\.99016\.42816\.64316\.64316\.67216\.67216\.67216\.672ENER03Wind powerErr\.199\.462199\.462228\.317228\.317201\.337201\.337199\.462199\.462224\.436224\.436196\.238196\.238206\.762215\.964206\.762215\.964224\.436224\.436234\.892207\.566234\.892207\.566DepthDEP01Make3DAbsRel0\.71550\.71550\.29310\.29310\.33990\.33990\.27070\.27070\.27460\.27460\.28540\.28540\.27130\.27020\.27130\.26510\.27460\.27460\.29430\.29430\.25870\.2724DEP02DIODEAbsRel0\.75820\.75820\.41800\.41800\.50400\.50400\.56580\.56580\.42610\.42610\.38590\.38590\.41470\.37380\.41810\.41810\.75820\.75820\.41880\.40170\.41900\.4171SeismicSEIS01STEADMAE \(s\)1\.42971\.42971\.11231\.11230\.68030\.68031\.42971\.42971\.61521\.61520\.67000\.67000\.67000\.67000\.67000\.67000\.94890\.94890\.94920\.94920\.59840\.0822Math\.MATH01QPObj\. gap0\.0035770\.0035770\.0024460\.0024460\.0027060\.0027060\.0035770\.0035770\.0024360\.0024360\.0024310\.0024310\.0024510\.0023980\.0024310\.0024370\.0026950\.0026950\.0024690\.0024690\.0022290\.002333MATH02NonconvexObj\. gap0\.18660\.18660\.18660\.18660\.18660\.18660\.18660\.18660\.18660\.18660\.15420\.15160\.16470\.18660\.16470\.18660\.18660\.18660\.18660\.18660\.15930\.1679TimeseriesTS01Beijing PM2\.5MAE57\.43757\.43756\.52456\.52457\.16557\.16564\.45364\.45356\.53656\.53657\.83757\.83759\.62455\.40357\.98455\.33156\.60856\.60858\.96658\.96658\.96658\.966AP / F1 fractions↑\\uparrowIndustryENG01MVTec ADPixel AP0\.39990\.39990\.40350\.40350\.39990\.39990\.39990\.39990\.48910\.48910\.46250\.46250\.48910\.48050\.48910\.48910\.47170\.47170\.40250\.40250\.40250\.4993ENG02MVTec LOCOPixel AP0\.14100\.14100\.14290\.14290\.14100\.14100\.14100\.14100\.16310\.16310\.14820\.14820\.14400\.14430\.14820\.14820\.14470\.14470\.14110\.14120\.14110\.1412ENG03VisAPixel AP0\.30220\.30220\.29850\.29850\.30220\.30220\.30220\.30220\.33550\.33550\.36130\.36130\.32140\.33420\.33550\.33550\.31190\.31190\.30380\.30400\.30380\.3040ENG04MPDDPixel AP0\.27700\.27700\.27790\.27790\.27700\.27700\.27700\.27700\.30650\.30650\.33330\.33330\.29480\.27700\.27700\.27700\.27700\.27700\.27700\.27700\.27630\.2770RemotesensingRS01SpaceNet7F10\.03280\.03280\.25070\.25070\.06870\.06870\.03280\.03280\.28810\.28810\.27190\.27400\.32530\.27400\.33000\.27400\.03280\.03280\.24840\.24840\.24350\.2899### A\.1Datasets and base predictors

#### Biology\.

BIO01 predicts transcriptional responses to gene knockouts in the IFN\-γ\\gammacondition of the Perturb\-CITE\-seq data of Frangieh et al\.\[[12](https://arxiv.org/html/2611.23718#bib.bib12)\]\. GEARS\[[33](https://arxiv.org/html/2611.23718#bib.bib33)\]provides the gene\-perturbation predictor, using gene relationships to represent the effects of genetic interventions\. We use GEARS 0\.1\.2 and evaluate RNA\-expression MSE, with observations grouped by the perturbed gene\.

#### Chemistry\.

CHEM01 estimates aqueous solubility on ESOL\[[9](https://arxiv.org/html/2611.23718#bib.bib9)\], whereas CHEM02 predicts molecular lipophilicity on the Lipophilicity collection in MoleculeNet\[[47](https://arxiv.org/html/2611.23718#bib.bib47)\]\. Both use Uni\-Mol\[[53](https://arxiv.org/html/2611.23718#bib.bib53)\]with property\-specific regression readouts\. RMSE measures the prediction error, and molecular scaffolds define the groups used for feedback validation\.

#### Materials\.

MAT01 predicts exfoliation energy for two\-dimensional materials, and MAT02 predicts the highest\-frequency phonon peak\. The data come from thematbench\_jdft2dandmatbench\_phononstasks, respectively\[[11](https://arxiv.org/html/2611.23718#bib.bib11)\]\. Both predictors use CGCNN\[[48](https://arxiv.org/html/2611.23718#bib.bib48)\]to represent crystal structures as atomic graphs\. We measure MAE in meV/atom for MAT01 and in cm\-1for MAT02, grouping observations by chemical formula\.

#### Physical dynamics\.

PHY01, PHY02, and PHY03 use the Burgers, advection, and reaction–diffusion simulations in PDEBench\[[38](https://arxiv.org/html/2611.23718#bib.bib38)\]\. Each task has an equation\-specific one\-dimensional Fourier neural operator\[[24](https://arxiv.org/html/2611.23718#bib.bib24)\]\. PHY03 uses the checkpoint’s native single\-frame input\. Prediction errors are measured by relativeL2L\_\{2\}distance over the task’s complete scoring support; frames from the same initial condition remain in the same group\.

#### Energy\.

ENER01 predicts battery cycle life on the sodium\-ion subset of BatteryLife\[[40](https://arxiv.org/html/2611.23718#bib.bib40),[42](https://arxiv.org/html/2611.23718#bib.bib42)\]\. Its base predictor is theMIX\_largecheckpoint of the pretrained battery transformer, abbreviated PBT\-L\[[41](https://arxiv.org/html/2611.23718#bib.bib41)\], and the metric is MAPE\. ENER02 forecasts building electricity use in Building Data Genome 2\[[27](https://arxiv.org/html/2611.23718#bib.bib27)\]; ENER03 forecasts wind power in SDWPF\[[54](https://arxiv.org/html/2611.23718#bib.bib54)\]\. Both forecasting tasks use DLinear\[[52](https://arxiv.org/html/2611.23718#bib.bib52)\]with 96 input steps and a 24\-step prediction horizon\. Their MAEs are averaged over buildings and turbines, respectively\.

#### Depth estimation\.

DEP01 and DEP02 predict metric depth from RGB images on Make3D\[[34](https://arxiv.org/html/2611.23718#bib.bib34)\]and DIODE\[[45](https://arxiv.org/html/2611.23718#bib.bib45)\]\. Both start from the ViT\-S metric Depth Anything V2 predictor with the VKITTI outdoor checkpoint, abbreviated DAv2\-S\[[50](https://arxiv.org/html/2611.23718#bib.bib50)\]\. AbsRel is evaluated on valid depth pixels and then averaged over capture groups for Make3D and scenes for DIODE\.

#### Seismology\.

SEIS01 estimates P\-wave arrival times from the seismic waveforms in STEAD\[[28](https://arxiv.org/html/2611.23718#bib.bib28)\]\. We use PhaseNet\[[56](https://arxiv.org/html/2611.23718#bib.bib56)\]initialized from the SCEDC v2 checkpoint\. Arrival\-time MAE is reported in seconds\.

#### Constrained optimization\.

MATH01 and MATH02 use the parametric quadratic and nonconvex problem families supplied with DC3\[[10](https://arxiv.org/html/2611.23718#bib.bib10)\]\. Both retain the originalNNSolver, including its completion and correction operations\. We report relative objective gaps using the OSQP reference for MATH01 and the IPOPT local\-solution reference for MATH02, while retaining the native feasibility checks\.

#### Time\-series forecasting\.

TS01 forecasts PM2\.5 concentrations in the Beijing Multi\-Site Air Quality collection\[[7](https://arxiv.org/html/2611.23718#bib.bib7)\]\. Its NLinear predictor\[[52](https://arxiv.org/html/2611.23718#bib.bib52)\]uses shared\-channel weights, a 96\-step input window, and a 24\-step forecast horizon\. MAE measures prediction accuracy, and validation respects the temporal ordering of observations\.

#### Industrial inspection\.

ENG01, ENG02, ENG03, and ENG04 localize anomalies in MVTec AD\[[3](https://arxiv.org/html/2611.23718#bib.bib3)\], MVTec LOCO\[[4](https://arxiv.org/html/2611.23718#bib.bib4)\], VisA\[[57](https://arxiv.org/html/2611.23718#bib.bib57)\], and MPDD\[[18](https://arxiv.org/html/2611.23718#bib.bib18)\], respectively\. The four tasks share the AnomalyCLIP VisA initialization\[[55](https://arxiv.org/html/2611.23718#bib.bib55)\]and a zero\-initialized, 769\-parameter residual readout, denoted AnCLIP\+R\. This readout belongs to the common predictor used by all update strategies\. Pixel AP is computed from the original\-resolution anomaly masks and aggregated by category\.

#### Remote sensing\.

RS01 predicts building\-change masks from pairs of SpaceNet7 images\[[43](https://arxiv.org/html/2611.23718#bib.bib43)\]\. The base predictor is ChangeMamba\[[6](https://arxiv.org/html/2611.23718#bib.bib6)\], abbreviated ChMamba, initialized from its LEVIR\-CD\+ checkpoint\. F1 measures the agreement between the predicted changes and the building\-change masks\.

### A\.2Feedback baselines

The four controls distinguish the initial predictor from three ways of incorporating returned measurements\.

#### Base\.

Base retains the task\-specific predictor described above throughout the feedback stream\. Its architecture, initialization, and output transformation are shared with the corresponding updated predictors\. It establishes the prediction quality before feedback\-driven adaptation\.

#### Adam\.

Adam\[[20](https://arxiv.org/html/2611.23718#bib.bib20)\]repeatedly fits a fixed local subset of the model’s parameters to accumulated feedback, leaving the remaining parameters unchanged\. The editable subset is fixed across rounds, and internal validation selects the deployed update\. This control evaluates feedback\-driven parameter optimization without revising the editing locations\.

#### Memory\.

Memory corrects predictions using stored feedback residuals while keeping the model weights fixed\. It averages nearby residuals with inverse\-distance weights, following Shepard’s interpolation principle\[[35](https://arxiv.org/html/2611.23718#bib.bib35)\]\. Validation chooses among the neighborhood\-based corrections, a global residual mean, and their shrinkage settings\.

#### Calib\.

Calib fits an output scale and offset to returned observations, following the model\-output postprocessing approach of Glahn and Lowry\[[13](https://arxiv.org/html/2611.23718#bib.bib13)\]\. For binary predictions, the affine transformation acts on logits before probability conversion, placing it within the post\-hoc calibration family studied by Guo et al\.\[[14](https://arxiv.org/html/2611.23718#bib.bib14)\]\. The underlying predictor weights remain fixed\.

### A\.3LLM services and implementation details

#### Models and generation settings\.

Experiments use the DeepSeek Flash service \(deepseek\-flash, documented by DeepSeek as DeepSeek\-V4\.1\-Flash\-1017\)\[[59](https://arxiv.org/html/2611.23718#bib.bib59)\]and Claude Fable 5 \(claude\-fable\-5\)\[[58](https://arxiv.org/html/2611.23718#bib.bib58)\]\.

#### Evidence supplied to the LLM\.

Setup calls receive the task’s input/output contract, native model source, and complete named\-parameter inventory, without target values\. Later calls add summaries of released feedback, previous edits, and completed candidate evaluations\. All calls use text messages with JSON\-serialized evidence\. Requests, replies, and validation records are retained together, including unsuccessful attempts\.

## Appendix BAdditional visual and scientific cases

#### Industrial error maps\.

Figures[7](https://arxiv.org/html/2611.23718#A2.F7)–[13](https://arxiv.org/html/2611.23718#A2.F13)show four MVTec AD images, one VisA image, and two MPDD images\. Each map shows\|σ⁡\(z\)−y\|\|\\sigma\(z\)\-y\|after the registered interpolation of native logits to the original binary\-mask resolution\. The table reports original\-resolution pixel AP, a ranking metric distinct from probability error\. All methods share the same display scale\. Target\-error panels show the zero self\-comparison reference\.

#### Building changes and depth\.

Main Figures[5](https://arxiv.org/html/2611.23718#S4.F5)and[6](https://arxiv.org/html/2611.23718#S4.F6)retain the complete DIODE, Make3D, and SpaceNet7 comparisons\. Figures[14](https://arxiv.org/html/2611.23718#A2.F14)–[18](https://arxiv.org/html/2611.23718#A2.F18)show five additional Make3D objects\. Each method shows depth prediction and pixel AbsRel with common scales\. The target is paired with its zero\-error reference\. Image metrics use the full valid support\.

#### Other scientific cases\.

Figures[19](https://arxiv.org/html/2611.23718#A2.F19)–[24](https://arxiv.org/html/2611.23718#A2.F24)show biological, molecular, material, physical\-field, battery, seismic\-arrival, and constrained\-QP examples\. Curves use the saved preview coordinates; tables use the complete object metrics\. The STEAD case shows the MLOD object, target P arrival at 8\.01 s, and the 7\.98 s HL\-Global pick\.

RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/input.png)

Target: mask

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/target_error.png)

Base

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__Base.png)

Adam

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__Adam.png)

Memory

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__Base.png)

Calib

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__Base.png)

HypoLoop

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__HypoLoop.png)

HL\-LLM

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__HypoLoop.png)

HL\-Fixed

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__HypoLoop.png)

HL\-Once

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/error__HL-Once.png)

Absolute probability error![Refer to caption](https://arxiv.org/html/2611.23718v1/probability.png)

Figure 7:MVTec AD carpet \(Deepseek\)\.HypoLoop reaches 0\.7776 AP versus 0\.5899 for Adam \(18\.77 percentage points higher\)\. Maps show absolute probability error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/input.png)

Target: mask

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/target_error.png)

Base

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__Base.png)

Adam

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__Adam.png)

Memory

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__Base.png)

Calib

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__Base.png)

HypoLoop

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__HypoLoop.png)

HL\-LLM

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__HypoLoop.png)

HL\-Fixed

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__HypoLoop.png)

HL\-Once

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_480c4e09caf7016ecf20__deepseek/error__HL-Once.png)

Absolute probability error![Refer to caption](https://arxiv.org/html/2611.23718v1/probability.png)

Figure 8:MVTec AD carpet \(Deepseek\)\.HypoLoop reaches 0\.9771 AP versus 0\.4914 for Adam \(48\.57 percentage points higher\)\. Maps show absolute probability error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/input.png)

Target: mask

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/target_error.png)

Base

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__Base.png)

Adam

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__Adam.png)

Memory

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__Base.png)

Calib

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__Base.png)

HL\-Global

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__HL-Global.png)

HypoLoop

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__HypoLoop.png)

HL\-Fixed

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__HypoLoop.png)

HL\-Auto

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_05c224adcdfe47cfe6b6__claude/error__HL-Auto.png)

Absolute probability error![Refer to caption](https://arxiv.org/html/2611.23718v1/probability.png)

Figure 9:MVTec AD leather \(Claude\)\.HL\-Global reaches 0\.7699 AP versus 0\.4339 for Adam \(33\.60 percentage points higher\)\. Maps show absolute probability error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/input.png)

Target: mask

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/target_error.png)

Base

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__Base.png)

Adam

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__Adam.png)

Memory

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__Base.png)

Calib

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__Base.png)

HypoLoop

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__HypoLoop.png)

HL\-Fixed

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__HypoLoop.png)

HL\-Global

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__HL-Global.png)

HL\-LLM

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7d8a5e7f678b1994abe8__claude/error__HL-LLM.png)

Absolute probability error![Refer to caption](https://arxiv.org/html/2611.23718v1/probability.png)

Figure 10:MVTec AD leather \(Claude\)\.HypoLoop reaches 0\.8159 AP versus 0\.3527 for Adam \(46\.32 percentage points higher\)\. Maps show absolute probability error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/input.png)

Target: mask

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/target_error.png)

Base

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__Base.png)

Adam

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__Adam.png)

Memory

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__Base.png)

Calib

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__Base.png)

HL\-Once

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__HL-Once.png)

HL\-Auto

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__HL-Auto.png)

HL\-LLM

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__HL-LLM.png)

HypoLoop

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG03_0f32cf389d2c1920c7fdecda__deepseek/error__HypoLoop.png)

Absolute probability error![Refer to caption](https://arxiv.org/html/2611.23718v1/probability.png)

Figure 11:VisA chewinggum \(Deepseek\)\.HL\-Once reaches 0\.9223 AP versus 0\.6129 for Base \(30\.94 percentage points higher\)\. Maps show absolute probability error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/input.png)

Target: mask

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/target_error.png)

Base

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__Base.png)

Adam

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__Adam.png)

Memory

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__Base.png)

Calib

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__Base.png)

HL\-Auto

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__HL-Auto.png)

HypoLoop

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__HypoLoop.png)

HL\-LLM

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__HL-LLM.png)

HL\-Global

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_0ea6d9a14e2c9431c26e2821__deepseek/error__HL-Global.png)

Absolute probability error![Refer to caption](https://arxiv.org/html/2611.23718v1/probability.png)

Figure 12:MPDD metal\_plate \(Deepseek\)\.HL\-Auto reaches 0\.9984 AP versus 0\.911 for Adam \(8\.74 percentage points higher\)\. Maps show absolute probability error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/input.png)

Target: mask

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG01_7c0ebec37ccf9ef32a0a__deepseek/target_error.png)

Base

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__Base.png)

Adam

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__Adam.png)

Memory

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__Base.png)

Calib

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__Base.png)

HL\-Auto

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__HL-Auto.png)

HypoLoop

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__HypoLoop.png)

HL\-LLM

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__Base.png)

HL\-Fixed

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/ENG04_ea461ee7a92c9f2446f2552f__claude/error__Base.png)

Absolute probability error![Refer to caption](https://arxiv.org/html/2611.23718v1/probability.png)

Figure 13:MPDD metal\_plate \(Claude\)\.HL\-Auto reaches 0\.9977 AP versus 0\.5662 for Adam \(43\.16 percentage points higher\)\. Maps show absolute probability error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/input.png)

Target: depth

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/target_error.png)

Base: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__Base.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__Base.png)

Adam: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__Adam.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__Adam.png)

Memory: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__Memory.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__Memory.png)

Calib: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__Calib.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__Calib.png)

HL\-Global: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__HL-Global.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__HL-Global.png)

HypoLoop: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__HypoLoop.png)

HL\-Once: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__HypoLoop.png)

HL\-LLM: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/prediction__HL-LLM.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_4bf8b98e51d0849bf45a8a9a__claude/error__HL-LLM.png)

Depth \(m\), log scale

![Refer to caption](https://arxiv.org/html/2611.23718v1/x1.png)

Pixel AbsRel

![Refer to caption](https://arxiv.org/html/2611.23718v1/x2.png)

Figure 14:Make3D math12\-p\-343t0 \(Claude\)\.HL\-Global reaches 0\.2352 AbsRel versus 0\.2724 for Memory \(13\.63% lower\)\. Each method pairs depth and AbsRel error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/input.png)

Target: depth

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/target_error.png)

Base: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__Base.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__Base.png)

Adam: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__Adam.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__Adam.png)

Memory: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__Memory.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__Memory.png)

Calib: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__Calib.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__Calib.png)

HL\-LLM: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__HL-LLM.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__HL-LLM.png)

HL\-Fixed: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__HL-LLM1.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__HL-LLM1.png)

HypoLoop: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__HypoLoop.png)

HL\-Once: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_c850062bccd7b8dd2c91b350__claude/error__HypoLoop.png)

Depth \(m\), log scale

![Refer to caption](https://arxiv.org/html/2611.23718v1/x1.png)

Pixel AbsRel

![Refer to caption](https://arxiv.org/html/2611.23718v1/x2.png)

Figure 15:Make3D op29\-p\-325t000 \(Claude\)\.HL\-LLM reaches 0\.07849 AbsRel versus 0\.1211 for Adam \(35\.21% lower\)\. Each method pairs depth and AbsRel error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/input.png)

Target: depth

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/target_error.png)

Base: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Base.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Base.png)

Adam: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Adam.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Adam.png)

Memory: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Memory.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Memory.png)

Calib: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__Calib.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__Calib.png)

HL\-LLM: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HL-LLM.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HL-LLM.png)

HL\-Fixed: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HL-LLM.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HL-LLM.png)

HypoLoop: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HypoLoop.png)

HL\-Once: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_7436b13f5168db45d49e771f__deepseek/error__HypoLoop.png)

Depth \(m\), log scale

![Refer to caption](https://arxiv.org/html/2611.23718v1/x1.png)

Pixel AbsRel

![Refer to caption](https://arxiv.org/html/2611.23718v1/x2.png)

Figure 16:Make3D op27\-p\-077t000 \(Deepseek\)\.HL\-LLM reaches 0\.07843 AbsRel versus 0\.1285 for Memory \(38\.98% lower\)\. Each method pairs depth and AbsRel error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/input.png)

Target: depth

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/target_error.png)

Base: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__Base.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__Base.png)

Adam: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__Adam.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__Adam.png)

Memory: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__Memory.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__Memory.png)

Calib: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__Calib.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__Calib.png)

HL\-Global: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__HL-Global.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__HL-Global.png)

HL\-Auto: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__HL-Auto.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__HL-Auto.png)

HL\-Local: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__HL-Local.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__HL-Local.png)

HypoLoop: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_b1d36ec8f7a366b4a67f5545__deepseek/error__HypoLoop.png)

Depth \(m\), log scale

![Refer to caption](https://arxiv.org/html/2611.23718v1/x1.png)

Pixel AbsRel

![Refer to caption](https://arxiv.org/html/2611.23718v1/x2.png)

Figure 17:Make3D combined1\-p\-108t0 \(Deepseek\)\.HL\-Global reaches 0\.1 AbsRel versus 0\.1597 for Calib \(37\.38% lower\)\. Each method pairs depth and AbsRel error\.RGB input

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/input.png)

Target: depth

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/target.png)

Target error: 0

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/target_error.png)

Base: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__Base.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__Base.png)

Adam: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__Adam.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__Adam.png)

Memory: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__Memory.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__Memory.png)

Calib: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__Calib.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__Calib.png)

HL\-Global: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__HL-Global.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__HL-Global.png)

HL\-Auto: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__HL-Auto.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__HL-Auto.png)

HypoLoop: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__HypoLoop.png)

HL\-Once: pred\. / error

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/prediction__HypoLoop.png)

![Refer to caption](https://arxiv.org/html/2611.23718v1/figures/cases/DEP03_d3b8b1eeac4b4e57eca7bc45__claude/error__HypoLoop.png)

Depth \(m\), log scale

![Refer to caption](https://arxiv.org/html/2611.23718v1/x1.png)

Pixel AbsRel

![Refer to caption](https://arxiv.org/html/2611.23718v1/x2.png)

Figure 18:Make3D op27\-p\-108t000 \(Claude\)\.HL\-Global reaches 0\.09752 AbsRel versus 0\.1447 for Adam \(32\.61% lower\)\. Each method pairs depth and AbsRel error\.\(a\)IFNγ\\gammaperturbation \(DeepSeek\)TargetMemoryHL\-Once

\(b\)ESOL \(DeepSeek\)Target

Calib

HL\-Auto

Figure 19:Biology and ESOL cases \(DeepSeek\)\.Left: the ACSL3 example plots predicted and target expression at sampled gene coordinates\. Full\-gene MSE is 0\.02539 for HL\-Once versus 0\.02783 for Memory\. Right: single\-molecule absolute error is 0\.04876 for HL\-Auto and HL\-Fixed versus 1\.264 for Calib\. The square marker denotes zero prediction error\.\(a\)Lipophilicity \(Claude\)Target

Adam

HypoLoop

\(b\)Exfoliation energy \(DeepSeek\)Target

Adam

HL\-Global

Figure 20:Lipophilicity and exfoliation\-energy cases\.Per\-object absolute error on lipophilicity \(Claude\) is 0\.005249 for HypoLoop versus 0\.2490 for Adam\. On exfoliation energy \(DeepSeek\), it is 0\.7772 for HL\-Global versus 12\.09 for Adam\. Square markers denote zero prediction error\.\(a\)Phonon peak \(Claude\)Target

Adam

HL\-Global

\(b\)Burgers \(DeepSeek\)TargetAdamHL\-Global

Figure 21:Phonon\-peak and Burgers cases\.Left: on the selected material \(Claude\), HL\-Global reduces absolute error from 0\.3002 for Adam to 0\.006038; the square marker denotes zero error\. Right: Burgers predictions \(DeepSeek\) are plotted along sampled spatial field coordinates\. Full\-field relativeL2L\_\{2\}error decreases from 0\.1207 for Adam to 0\.006426 for HL\-Global\.\(a\)Advection \(Claude\)TargetMemoryHL\-Global

\(b\)Reaction–diffusion \(Claude\)TargetCalibHL\-Once

Figure 22:Advection and reaction–diffusion cases \(Claude\)\.Curves follow sampled spatial field coordinates; scores are full\-field relativeL2L\_\{2\}errors\. On advection, HL\-Global obtains9\.868×10−49\.868\\times 10^\{\-4\}versus3\.980×10−33\.980\\times 10^\{\-3\}for Memory\. On reaction–diffusion, HL\-Once obtains 0\.04716 versus 0\.1443 for Calib\.\(a\)Na\-ion battery \(DeepSeek\)Target

Adam

HL\-Once

\(b\)MVTec AD \(DeepSeek\)Target

Adam

HypoLoop

Figure 23:Na\-ion battery and MVTec AD cases \(DeepSeek\)\.Left: single\-battery MAPE decreases from46\.84%46\.84\\%for Adam to0\.2370%0\.2370\\%for HL\-Once\. Right: image\-level pixel AP increases from 0\.08490 for Adam to 0\.7601 for HypoLoop, HL\-LLM, and HL\-Fixed \(\+67\.52 percentage points\)\. The ideal reference is zero MAPE and AP of one\.\(a\)STEAD \(Claude\)TargetBaseHL\-Global

\(b\)Constrained QP \(DeepSeek\)TargetAdamHL\-Global

Figure 24:Seismic\-arrival and constrained\-QP cases\.Left: STEAD arrival responses at MLOD \(Claude\), with the target P arrival at 8\.01 s\. HL\-Global picks 7\.98 s, giving 0\.03 s absolute error versus 0\.07 s for Base, Memory, and Calib\. Right: the QP example \(DeepSeek\) plots solution coordinates\. The feasible solution’s relative objective gap decreases from7\.867×10−47\.867\\times 10^\{\-4\}for Adam to3\.464×10−43\.464\\times 10^\{\-4\}for HL\-Global\.

## Appendix CNative model structures and deployed editing locations

\(a\)Complete FNO computational core\(b\)All native parameter tensors and actual deployed changes
Figure 25:Where editing acts in the Burgers predictor\.The registered FNO1d follows the Fourier\-neural\-operator architecture\[[24](https://arxiv.org/html/2611.23718#bib.bib24)\]and PDEBench implementation\[[38](https://arxiv.org/html/2611.23718#bib.bib38)\]\. Each operator block adds parallel spectral and pointwise branches; GELU follows blocks 0–2 andfc1\. The spectral branch applies FFT, multiplication of 12 learned modes, and inverse FFT\. Native padding/cropping is preserved\. Each map cell reports the exact number of deployed native real\-coordinate values differing fromW0W\_\{0\}; blank cells equal zero\. Fill intensity is the changed fraction of that tensor, on a linear\[0,1\]\[0,1\]scale, gray for fixed and purple for dynamic locations\. The twelve columns cover both services, both location policies, and all three deployment boundaries\. Complex tensors \(C\) contain two real coordinates per complex entry, in interleaved real/imaginary order\. The complete inventory has 18 tensors and 43,137 real coordinates\. Dynamic selection concentrates onconv0\.weights1: DeepSeek shifts its 7,617\-coordinate slice from\[1130:8747\]to\[1152:8769\], while Claude keeps\[1394:9586\]\(8,192 coordinates\)\. Retained rounds repeat the deployed patch\.\(a\)Complete DC3 computational core\(b\)All native parameter tensors and actual deployed changes
Figure 26:Where editing acts in the constrained\-QP predictor\.The registered DC3 network includes its original equality\-completion and inequality\-correction operations\[[10](https://arxiv.org/html/2611.23718#bib.bib10)\]\. The network predicts 10 free variables from 90 right\-hand\-side coordinates, completes the 100\-dimensional solution, and applies up to 10 native correction steps\. Dropout is inactive during evaluation; BatchNorm running buffers remain fixed and are not trainable tensors\. The map covers all 10 parameter tensors and 61,210 real coordinates\. Counts, blank cells, linear fill intensities, and deployment boundaries follow Figure[25](https://arxiv.org/html/2611.23718#A3.F25)\. Both policies can touch the middle block: the difference is which coordinates receive the same per\-service budget\. DeepSeek moves from a mixed scope tonet\.4\.weight\[14390:22582\]\(8,192 coordinates\) before B2; Claude moves tonet\.4\.weight\[14390:22490\]\(8,100 coordinates\) before E\.
## Appendix DAnalysis of Where and How

The two editing decisions change the variables and objective of a weight update\. We analyze the squared\-loss local problem in Main Equation[2](https://arxiv.org/html/2611.23718#S3.E2)\. The results connect parameter location to the corrections it can express, sample weighting to the direction of the fitted patch, and patch size to changes in native predictions\.

### D\.1Setup

Fix one round and flatten its valid feedback outputs into a vector\. Letr=f~W0​\(Xt\)−y~r=\\widetilde\{f\}\_\{W\_\{0\}\}\(X\_\{t\}\)\-\\widetilde\{y\}be the normalized residual,A=diag⁡\(a\)A=\\operatorname\{diag\}\(a\)withai\>0a\_\{i\}\>0and∑iai=1\\sum\_\{i\}a\_\{i\}=1, andJMJ\_\{M\}the prediction Jacobian with respect to the normalized editable coordinateszz\. Thus the local residual isr\+JM​zr\+J\_\{M\}z\. LetJR,MJ\_\{R,M\}denote the corresponding reference Jacobian andB=diag⁡\(b\)B=\\operatorname\{diag\}\(b\)its nonnegative weights\. Define

RM\\displaystyle R\_\{M\}=γ​cM​I\+λ​JR,M𝖳​B​JR,M,\\displaystyle=\\gamma c\_\{M\}I\+\\lambda J\_\{R,M\}^\{\\mathsf\{T\}\}BJ\_\{R,M\},\(D\.1\)FM,a​\(z\)\\displaystyle F\_\{M,a\}\(z\)=12​‖r\+JM​z‖A2\+12​z𝖳​RM​z,\\displaystyle=\\tfrac\{1\}\{2\}\\\|r\+J\_\{M\}z\\\|\_\{A\}^\{2\}\+\\tfrac\{1\}\{2\}z^\{\\mathsf\{T\}\}R\_\{M\}z,where‖v‖A2=v𝖳​A​v\\\|v\\\|\_\{A\}^\{2\}=v^\{\\mathsf\{T\}\}Av,γ​cM\>0\\gamma c\_\{M\}\>0, andλ≥0\\lambda\\geq 0\. This is half the squared\-loss objective in Main Equation[2](https://arxiv.org/html/2611.23718#S3.E2)\. We study its exact minimizer before patch scaling; feedback weights and penalty coefficients are held fixed within each fit\. Write

CM=JM𝖳​A​JM\+RM,bM=JM𝖳​A​r\.C\_\{M\}=J\_\{M\}^\{\\mathsf\{T\}\}AJ\_\{M\}\+R\_\{M\},\\qquad b\_\{M\}=J\_\{M\}^\{\\mathsf\{T\}\}Ar\.\(D\.2\)The positive ridge term makesCMC\_\{M\}positive definite\.

### D\.2Where: the value of an editing location

#### Proposition 1 \(Location\-dependent correction\)\.

For a coordinate setMM, the unique solution and its reduction in the regularized fitting objective are

zM⋆\\displaystyle z\_\{M\}^\{\\star\}=−CM−1​bM,\\displaystyle=\-C\_\{M\}^\{\-1\}b\_\{M\},\(D\.3\)G⁡\(M,a,r\)\\displaystyle G\(M;a,r\)≡FM,a​\(0\)−FM,a​\(zM⋆\)\\displaystyle\\equiv F\_\{M,a\}\(0\)\-F\_\{M,a\}\(z\_\{M\}^\{\\star\}\)=12​bM𝖳​CM−1​bM\.\\displaystyle=\\tfrac\{1\}\{2\}b\_\{M\}^\{\\mathsf\{T\}\}C\_\{M\}^\{\-1\}b\_\{M\}\.In particular,G=0G=0exactly whenJM𝖳​A​r=0J\_\{M\}^\{\\mathsf\{T\}\}Ar=0\. For any finite collectionℳk\\mathcal\{M\}\_\{k\}of locations with the same editable\-coordinate budgetkk, its best attainable local objective is

minM∈ℳk,z⁡FM,a​\(z\)=12​‖r‖A2−maxM∈ℳk⁡G⁡\(M,a,r\)\.\\min\_\{M\\in\\mathcal\{M\}\_\{k\},z\}F\_\{M,a\}\(z\)=\\tfrac\{1\}\{2\}\\\|r\\\|\_\{A\}^\{2\}\-\\max\_\{M\\in\\mathcal\{M\}\_\{k\}\}G\(M;a,r\)\.\(D\.4\)

#### Proof\.

Expanding the quadratic gives

FM,a​\(z\)=12​‖r‖A2\+bM𝖳​z\+12​z𝖳​CM​z\.F\_\{M,a\}\(z\)=\\tfrac\{1\}\{2\}\\\|r\\\|\_\{A\}^\{2\}\+b\_\{M\}^\{\\mathsf\{T\}\}z\+\\tfrac\{1\}\{2\}z^\{\\mathsf\{T\}\}C\_\{M\}z\.\(D\.5\)Its gradient vanishes only atzM⋆=−CM−1​bMz\_\{M\}^\{\\star\}=\-C\_\{M\}^\{\-1\}b\_\{M\}\. Completing the square yields

FM,a​\(z\)\\displaystyle F\_\{M,a\}\(z\)=12​‖r‖A2−12​bM𝖳​CM−1​bM\\displaystyle=\\tfrac\{1\}\{2\}\\\|r\\\|\_\{A\}^\{2\}\-\\tfrac\{1\}\{2\}b\_\{M\}^\{\\mathsf\{T\}\}C\_\{M\}^\{\-1\}b\_\{M\}\(D\.6\)\+12​\(z−zM⋆\)𝖳​CM​\(z−zM⋆\)\.\\displaystyle\+\\tfrac\{1\}\{2\}\(z\-z\_\{M\}^\{\\star\}\)^\{\\mathsf\{T\}\}C\_\{M\}\(z\-z\_\{M\}^\{\\star\}\)\.The last term is nonnegative and vanishes at the unique minimizer\. Positive definiteness givesG=0G=0if and only ifbM=0b\_\{M\}=0\. SinceFM,a​\(0\)F\_\{M,a\}\(0\)is common to all locations, minimizing overℳk\\mathcal\{M\}\_\{k\}proves Equation[D\.4](https://arxiv.org/html/2611.23718#A4.E4)\.□\\square

The relevant quantity is the residual’s alignment with the selected response directions, adjusted by their curvature and penalties\. Equal coordinate counts can give different values ofGG\. This explains why a matched\-budget comparison can detect a location effect with unchanged solver settings\.

#### Accumulating feedback can change the best location\.

Consider two available coordinates, budgetk=1k=1, andRM=ρ\>0R\_\{M\}=\\rho\>0\. The first feedback observation has residual11and sensitivity\(1,0\)\(1,0\)\. Editing coordinate 1 givesG=1/\[2​\(1\+ρ\)\]G=1/\[2\(1\+\\rho\)\]; coordinate 2 gives zero\. Now append three observations, each with residual11and sensitivity\(0,1\)\(0,1\), and weight all four observations uniformly\. The gains become

G1=\(1/4\)22​\(1/4\+ρ\),G2=\(3/4\)22​\(3/4\+ρ\)\.G\_\{1\}=\\frac\{\(1/4\)^\{2\}\}\{2\(1/4\+\\rho\)\},\\qquad G\_\{2\}=\\frac\{\(3/4\)^\{2\}\}\{2\(3/4\+\\rho\)\}\.\(D\.7\)Sincep2/\(p\+ρ\)p^\{2\}/\(p\+\\rho\)is strictly increasing forp\>0p\>0,G2\>G1G\_\{2\}\>G\_\{1\}\. The original feedback is retained, the budget stays at one coordinate, and the preferred location changes as evidence accumulates\.

### D\.3How: how weights change the fitted patch

FixMM,rr,J=JMJ=J\_\{M\}, andR=RMR=R\_\{M\}\. Leta⁡\(α\)a\(\\alpha\)be a differentiable path of positive normalized weights, witha⁡\(0\)=aa\(0\)=a\. Denote the fitted residual bye=r\+J​z⋆e=r\+Jz^\{\\star\}, and letC=J𝖳​A​J\+RC=J^\{\\mathsf\{T\}\}AJ\+Ratα=0\\alpha=0\.

#### Proposition 2 \(Weight\-to\-patch sensitivity\)\.

Writing a dot for the derivative atα=0\\alpha=0, the fitted solution satisfies

z˙⋆=−C−1​J𝖳​diag⁡\(a˙\)​e\.\\dot\{z\}^\{\\star\}=\-C^\{\-1\}J^\{\\mathsf\{T\}\}\\operatorname\{diag\}\(\\dot\{a\}\)e\.\(D\.8\)For the normalized exponential tilt

ai​\(α\)=ai​exp⁡\(α​si\)∑jaj​exp⁡\(α​sj\),s¯=∑jaj​sj,a\_\{i\}\(\\alpha\)=\\frac\{a\_\{i\}\\exp\(\\alpha s\_\{i\}\)\}\{\\sum\_\{j\}a\_\{j\}\\exp\(\\alpha s\_\{j\}\)\},\\qquad\\bar\{s\}=\\sum\_\{j\}a\_\{j\}s\_\{j\},\(D\.9\)this becomes

z˙⋆=−C−1∑iai\(si−s¯\)jiei,\\dot\{z\}^\{\\star\}=\-C^\{\-1\}\\sum\_\{i\}a\_\{i\}\(s\_\{i\}\-\\bar\{s\}\)j\_\{i\}e\_\{i\},\(D\.10\)whereji𝖳j\_\{i\}^\{\\mathsf\{T\}\}is rowiiofJJ\. For any differentiable evaluation lossV⁡\(z\)V\(z\)on a fixed evaluation set,

d​V​\(z⋆​\(α\)\)d​α\|0=−∇V\(z⋆\)𝖳C−1∑iai\(si−s¯\)jiei\.\\frac\{dV\(z^\{\\star\}\(\\alpha\)\)\}\{d\\alpha\}\\bigg\|\_\{0\}=\-\\nabla V\(z^\{\\star\}\)^\{\\mathsf\{T\}\}C^\{\-1\}\\sum\_\{i\}a\_\{i\}\(s\_\{i\}\-\\bar\{s\}\)j\_\{i\}e\_\{i\}\.\(D\.11\)

#### Proof\.

The normal equation at everyα\\alphaisJ𝖳​A​\(α\)​\(r\+J​z⋆​\(α\)\)\+R​z⋆​\(α\)=0J^\{\\mathsf\{T\}\}A\(\\alpha\)\(r\+Jz^\{\\star\}\(\\alpha\)\)\+Rz^\{\\star\}\(\\alpha\)=0\. Differentiation, withr,J,Rr,J,Rfixed, gives

C​z˙⋆\+J𝖳​diag⁡\(a˙\)​e=0\.C\\dot\{z\}^\{\\star\}\+J^\{\\mathsf\{T\}\}\\operatorname\{diag\}\(\\dot\{a\}\)e=0\.\(D\.12\)Invertibility ofCCproves Equation[D\.8](https://arxiv.org/html/2611.23718#A4.E8)\. Differentiating the normalized exponential givesa˙i=ai​\(si−s¯\)\\dot\{a\}\_\{i\}=a\_\{i\}\(s\_\{i\}\-\\bar\{s\}\), which proves Equation[D\.10](https://arxiv.org/html/2611.23718#A4.E10)\. Equation[D\.11](https://arxiv.org/html/2611.23718#A4.E11)follows by the chain rule\.□\\square

The weight change acts through each observation’s fitted residual and parameter sensitivity\. Its effect on evaluation loss is determined by the alignment in Equation[D\.11](https://arxiv.org/html/2611.23718#A4.E11)\. Replacingssby−s\-sreverses this first\-order effect\. For the clipped rulegi​\(α\)=clip⁡\(exp⁡\(α​ri\),l,u\)g\_\{i\}\(\\alpha\)=\\operatorname\{clip\}\(\\exp\(\\alpha r\_\{i\}\),l,u\), the same formula applies between clipping thresholds withsi=∂αlog⁡gis\_\{i\}=\\partial\_\{\\alpha\}\\log g\_\{i\}: this equalsrir\_\{i\}for an unclipped weight and zero for a saturated weight, followed by the same normalization\.

#### A directional example\.

Take a single editable bias,J=\(1,1\)𝖳J=\(1,1\)^\{\\mathsf\{T\}\}, residuals\(c,−c\)\(c,\-c\)withc\>0c\>0, and ridgeR=ρ\>0R=\\rho\>0\. Starting from uniform weights and using scoress=rs=rgives

z⋆​\(α\)=−c​tanh⁡\(α​c\)1\+ρ\.z^\{\\star\}\(\\alpha\)=\-\\frac\{c\\tanh\(\\alpha c\)\}\{1\+\\rho\}\.\(D\.13\)This follows by substitutinga1−a2=tanh⁡\(α​c\)a\_\{1\}\-a\_\{2\}=\\tanh\(\\alpha c\)into the scalar normal equation\. Uniform weights give zero bias update\. Forα\>0\\alpha\>0, the correction is negative and the positive residual becomesc\+z⋆​\(α\)∈\(0,c\)c\+z^\{\\star\}\(\\alpha\)\\in\(0,c\)\. Reversing the weighting makes the correction positive and increases that residual\. This provides a direct model of the directional choice tested by the DIODE weighting comparison\.

### D\.4From a fitted patch to native predictions

Letf~​\(W\)∈ℝn\\widetilde\{f\}\(W\)\\in\\mathbb\{R\}^\{n\}collect the native network’s normalized predictions on the fixed feedback inputs\. SetΔ=DM​zM⋆\\Delta=D\_\{M\}z\_\{M\}^\{\\star\}and apply the scaled patchW0\+τ​ΔW\_\{0\}\+\\tau\\Delta, with0<τ≤10<\\tau\\leq 1\. The scalarτ\\taucan include the patch scale and a radial cap\. Define

elin​\(τ\)\\displaystyle e\_\{\\rm lin\}\(\\tau\)=r\+τ​JM​zM⋆,\\displaystyle=r\+\\tau J\_\{M\}z\_\{M\}^\{\\star\},\(D\.14\)enat​\(τ\)\\displaystyle e\_\{\\rm nat\}\(\\tau\)=f~​\(W0\+τ​Δ\)−y~,\\displaystyle=\\widetilde\{f\}\(W\_\{0\}\+\\tau\\Delta\)\-\\widetilde\{y\},Elin​\(τ\)\\displaystyle E\_\{\\rm lin\}\(\\tau\)=∥elin\(τ\)∥A2,Enat\(τ\)=∥enat\(τ\)∥A2\.\\displaystyle=\\\|e\_\{\\rm lin\}\(\\tau\)\\\|\_\{A\}^\{2\},\\quad E\_\{\\rm nat\}\(\\tau\)=\\\|e\_\{\\rm nat\}\(\\tau\)\\\|\_\{A\}^\{2\}\.Assume each output has a Lipschitz gradient on the update segment, with constantsLiL\_\{i\}in native parameter norm\. WriteLA=\(∑iai​Li2\)1/2L\_\{A\}=\(\\sum\_\{i\}a\_\{i\}L\_\{i\}^\{2\}\)^\{1/2\}\.

#### Proposition 3 \(A sufficient condition for native error reduction\)\.

Withϵτ=12​LA​τ2​‖Δ‖22\\epsilon\_\{\\tau\}=\\tfrac\{1\}\{2\}L\_\{A\}\\tau^\{2\}\\\|\\Delta\\\|\_\{2\}^\{2\},

‖enat​\(τ\)−elin​\(τ\)‖A≤ϵτ,Enat​\(τ\)≤Elin​\(τ\)\+2​ϵτ​Elin​\(τ\)\+ϵτ2\.\\begin\{gathered\}\\\|e\_\{\\rm nat\}\(\\tau\)\-e\_\{\\rm lin\}\(\\tau\)\\\|\_\{A\}\\leq\\epsilon\_\{\\tau\},\\\\ \\begin\{aligned\} E\_\{\\rm nat\}\(\\tau\)&\\leq E\_\{\\rm lin\}\(\\tau\)\\\\ &\\quad\+2\\epsilon\_\{\\tau\}\\sqrt\{E\_\{\\rm lin\}\(\\tau\)\}\+\\epsilon\_\{\\tau\}^\{2\}\.\\end\{aligned\}\\end\{gathered\}\(D\.15\)LetS=bM𝖳​CM−1​bMS=b\_\{M\}^\{\\mathsf\{T\}\}C\_\{M\}^\{\-1\}b\_\{M\}andP=\(zM⋆\)𝖳​RM​zM⋆P=\(z\_\{M\}^\{\\star\}\)^\{\\mathsf\{T\}\}R\_\{M\}z\_\{M\}^\{\\star\}\. The local data\-error reduction is exactly

‖r‖A2−Elin​\(τ\)=τ⁡\(2−τ\)​S\+τ2​P\.\\\|r\\\|\_\{A\}^\{2\}\-E\_\{\\rm lin\}\(\\tau\)=\\tau\(2\-\\tau\)S\+\\tau^\{2\}P\.\(D\.16\)Consequently, native weighted squared error decreases whenever

τ⁡\(2−τ\)​S\+τ2​P\>2​ϵτ​Elin​\(τ\)\+ϵτ2\.\\tau\(2\-\\tau\)S\+\\tau^\{2\}P\>2\\epsilon\_\{\\tau\}\\sqrt\{E\_\{\\rm lin\}\(\\tau\)\}\+\\epsilon\_\{\\tau\}^\{2\}\.\(D\.17\)IfbM≠0b\_\{M\}\\neq 0, this condition holds for all sufficiently small positiveτ\\tau\.

#### Proof\.

The integral form of the first\-order remainder gives, for each output,

\|f~i\(W0\+τΔ\)−f~i\(W0\)−τ∇f~i\(W0\)𝖳Δ\|\\displaystyle\\left\|\\widetilde\{f\}\_\{i\}\(W\_\{0\}\+\\tau\\Delta\)\-\\widetilde\{f\}\_\{i\}\(W\_\{0\}\)\-\\tau\\nabla\\widetilde\{f\}\_\{i\}\(W\_\{0\}\)^\{\\mathsf\{T\}\}\\Delta\\right\|\(D\.18\)≤12​Li​τ2​‖Δ‖22\.\\displaystyle\\leq\\tfrac\{1\}\{2\}L\_\{i\}\\tau^\{2\}\\\|\\Delta\\\|\_\{2\}^\{2\}\.Taking the weighted norm proves the first bound\. Expanding the squared norm and applying Cauchy–Schwarz proves the second\. To obtain Equation[D\.16](https://arxiv.org/html/2611.23718#A4.E16), usebM𝖳​zM⋆=−Sb\_\{M\}^\{\\mathsf\{T\}\}z\_\{M\}^\{\\star\}=\-Sand\(zM⋆\)𝖳​JM𝖳​A​JM​zM⋆=S−P\(z\_\{M\}^\{\\star\}\)^\{\\mathsf\{T\}\}J\_\{M\}^\{\\mathsf\{T\}\}AJ\_\{M\}z\_\{M\}^\{\\star\}=S\-Pin the expansion ofElin​\(τ\)E\_\{\\rm lin\}\(\\tau\)\. Combining the two bounds gives Equation[D\.17](https://arxiv.org/html/2611.23718#A4.E17)\. IfbM≠0b\_\{M\}\\neq 0, thenS\>0S\>0: its left side is2​S​τ\+O⁡\(τ2\)2S\\tau\+O\(\\tau^\{2\}\), whereas the right side isO⁡\(τ2\)O\(\\tau^\{2\}\)\. A sufficiently small positive scale therefore gives a strict native\-error decrease\.□\\square

The three results describe a connected computation\. Location selection determines the available correction and its gainSS; weighting changes the fitted direction; patch scaling controls the nonlinear remainder\. HypoLoop then measures candidate predictions through the original network and records the outcome for the next editing decision\.

Similar Articles

Experimenting with hypersurface-constrained dynamic weight updating [P]

Reddit r/MachineLearning

An experimental language model architecture uses hypersurfaces for dynamic weight updating to reduce training parameters, achieving better performance than unrolled baselines while using only 16% of the parameters. The approach is tested on the FineWeb-Edu dataset and includes a GitHub implementation.

PhysLoop: Harnessing LLMs' Physics Awareness for Self-Improving Video Generation Models

Hugging Face Daily Papers

PhysLoop is a unified harness that uses LLMs' physical knowledge to guide video generation, selection, and correction, enabling physically consistent self-improvement of video models with limited human intervention. The authors release 100K videos, generation tools, and two evaluation datasets (PhysLoop-Gen and PhysLoop-Repair), marking a step toward recursive self-improvement in video generation.

DeLoop: Repeated Actions as Self-Supervision for Long-Horizon Agents

Hugging Face Daily Papers

DeLoop is a self-supervised preference optimization method that reduces repetitive tool-call loops in long-horizon language-model agents by using the agent's own rollouts as training pairs, cutting looping tasks from 57.3% to 6.1% under context compression and improving success rates on larger models.

Show HN: Watch weight-space programming in action with WebGPU

Hacker News Top

Show HN: Weight-Space Playground demos an LLM editing just 0.016% of another model's weights (131,072 of ~800M) to cure repetition loops in Qwen3.5-0.8B, cutting token-limit hits from 93% to 33.1% and boosting MATH-500 accuracy from 7.9% to 48.1% — all viewable and runnable in-browser via WebGPU.