Safe Domain Adaptation for Physics: Overcoming Nuisances, Label Shifts, and Simulation Priors

arXiv cs.LG Papers

Summary

This paper addresses the challenges of domain adaptation in physics, where simulations differ from experimental data in nuisances and label shifts. It proposes adaptive domain adaptation to focus on genuine physical mismatches and provides a model selection rule.

arXiv:2608.18190v1 Announce Type: new Abstract: Domain adaptation is widely used to make neural networks trained on simulations applicable to experimental data. Its premise is that the two domains differ only in nuisances, and that the quantity of interest is distributed identically in both. In physics neither assumption holds: simulations can be wrong about the physics, and the distribution of the target quantity - an energy spectrum, a redshift distribution - is often the measurement itself. We study the consequences of such mismatches on a toy air-shower benchmark in which a detector-response nuisance, a physical simulation shift, and an energy-spectrum shift can be switched on separately or together. Standard adversarial adaptation handles the conditional shifts, but once the two spectra differ it aligns them, replacing an uncontrolled bias by one anchored on the simulation prior. We present adaptive domain adaptation, which reweights the simulated events so as to focus domain adaptation on the genuine physical mismatch alone. Since the predicted spectrum depends on model training configuration, we provide a label-free model selection rule for selecting the near-the-best operation point.
Original Article
View Cached Full Text

Cached at: 08/20/26, 10:22 AM

# Overcoming Nuisances, Label Shifts, and Simulation Priors
Source: [https://arxiv.org/html/2608.18190](https://arxiv.org/html/2608.18190)
## Safe Domain Adaptation for Physics: Overcoming Nuisances, Label Shifts, and Simulation Priors

###### Abstract

Domain adaptation is widely used to make neural networks trained on simulations applicable to experimental data\. Its premise is that the two domains differ only in nuisances, and that the quantity of interest is distributed identically in both\. In physics neither assumption holds: simulations can be wrong about the physics, and the distribution of the target quantity — an energy spectrum, a redshift distribution — is often the measurement itself\. We study the consequences of such mismatches on a toy air\-shower benchmark in which a detector\-response nuisance, a physical simulation shift, and an energy\-spectrum shift can be switched on separately or together\. Standard adversarial adaptation handles the conditional shifts, but once the two spectra differ it aligns them, replacing an uncontrolled bias by one anchored on the simulation prior\. We present adaptive domain adaptation, which reweights the simulated events so as to focus domain adaptation on the genuine physical mismatch alone\. Since the predicted spectrum depends on model training configuration, we provide a label\-free model selection rule for selecting the near\-the\-best operation point\.

## 1Introduction

Machine learning \(ML\) methods, particularly neural networks, have become a powerful tool for data analysis in physics\. Their strength lies in the ability to identify complex patterns in the data that may be overlooked by, or are difficult to implement within, traditional rule\-based algorithmic frameworks\. Rather than relying on a handful of hand\-crafted variables, a neural network learns the mapping from the raw detector output to the quantity of interest directly from the data, exploiting correlations between many low\-level observables at once\. As a result, ML substantially improves the accuracy of data analyses, prompting its adoption across different applications\.

However, the same sensitivity to subtle features of the data that drives this success is also the primary limitation of neural networks\. Namely, a model may latch onto patterns that are specific to the training data set rather than onto physically meaningful structures\[[33](https://arxiv.org/html/2608.18190#bib.bib39),[43](https://arxiv.org/html/2608.18190#bib.bib40)\]\. Effectively, a network learns to interpolate within the feature phase space defined by its training data\. Applying it to data that lie outside this region constitutes an extrapolation, which is notoriously unreliable\. Such over\-specialization introduces biases that may be large and are, by construction, uncontrolled: the network’s output carries no indication that the input lies outside the region in which the model was trained\. Moreover, the sensitivity that makes a network accurate also makes it responsive to ever smaller differences between the training and application data, so that the more powerful the model, the more fragile its predictions under such a mismatch\.

This problem is of particular importance in physics, where models are typically trained on Monte Carlo \(MC\) simulations and subsequently applied to experimental data\[[14](https://arxiv.org/html/2608.18190#bib.bib25),[26](https://arxiv.org/html/2608.18190#bib.bib2),[41](https://arxiv.org/html/2608.18190#bib.bib7),[10](https://arxiv.org/html/2608.18190#bib.bib30),[29](https://arxiv.org/html/2608.18190#bib.bib31),[27](https://arxiv.org/html/2608.18190#bib.bib32),[40](https://arxiv.org/html/2608.18190#bib.bib33)\]\. MC simulations unavoidably differ from real\-world data, as they cannot perfectly replicate every physical process, detector response, and noise source\. These discrepancies are further compounded by the systematic uncertainties of the simulation itself, which stem from an imperfect knowledge of the underlying physics\. For example, in astrophysics the muon puzzle — a long\-standing discrepancy between the muon content of simulated and observed air showers — remains unresolved\[[7](https://arxiv.org/html/2608.18190#bib.bib8),[3](https://arxiv.org/html/2608.18190#bib.bib34),[1](https://arxiv.org/html/2608.18190#bib.bib9),[2](https://arxiv.org/html/2608.18190#bib.bib10),[4](https://arxiv.org/html/2608.18190#bib.bib41)\]\. Such mismatches lead to systematic shifts between the training \(MC simulations\) and target \(experimental data\) domains, potentially compromising the physical interpretation of the results\.

Domain adaptation \(DA\) is a broad class of techniques designed to make ML models robust against systematic shifts between domains\[[14](https://arxiv.org/html/2608.18190#bib.bib25),[26](https://arxiv.org/html/2608.18190#bib.bib2),[30](https://arxiv.org/html/2608.18190#bib.bib26),[18](https://arxiv.org/html/2608.18190#bib.bib27),[15](https://arxiv.org/html/2608.18190#bib.bib1),[6](https://arxiv.org/html/2608.18190#bib.bib28)\]\. In its standard formulation one is given labelled data from a*source*domain, distributed aspsrc​\(x,y\)p\_\{\\mathrm\{src\}\}\(x,y\), and unlabelled data from a*target*domain,ptgt​\(x,y\)p\_\{\\mathrm\{tgt\}\}\(x,y\), and the goal is to learn a predictor that is accurate on the target\. The most widely used family of methods is adversarial: an auxiliary classifier, the*adversary*, is trained to tell the two domains apart from the internal representationzzlearned by the network, while the network is trained to make this impossible\[[15](https://arxiv.org/html/2608.18190#bib.bib1)\]\. At convergence the representation is expected to retain the information required for the task while discarding the information that identifies the domain\. Such methods have been successfully applied in high\-energy physics\[[16](https://arxiv.org/html/2608.18190#bib.bib35),[36](https://arxiv.org/html/2608.18190#bib.bib13),[13](https://arxiv.org/html/2608.18190#bib.bib14),[11](https://arxiv.org/html/2608.18190#bib.bib15)\], including at the LHC\[[9](https://arxiv.org/html/2608.18190#bib.bib16),[20](https://arxiv.org/html/2608.18190#bib.bib36),[31](https://arxiv.org/html/2608.18190#bib.bib11)\], and in cosmology\[[32](https://arxiv.org/html/2608.18190#bib.bib38),[37](https://arxiv.org/html/2608.18190#bib.bib12)\]\.

Domain adaptation rests on two assumptions\. The first is that the domains differ only by a nuisance: the mapping from the data to the quantity of interest is shared,psrc​\(y\|x\)=ptgt​\(y\|x\)p\_\{\\mathrm\{src\}\}\(y\|x\)=p\_\{\\mathrm\{tgt\}\}\(y\|x\), and what changes is confined to features that carry no information aboutyy\. The canonical illustration is the MNIST\-M benchmark\[[15](https://arxiv.org/html/2608.18190#bib.bib1)\], in which the label is the digit and the domain shift is the coloured background\. Since the background is irrelevant to the digit, a background\-invariant representation transfers across the domains at no cost in accuracy\. The second assumption concerns the mechanism of the alignment\. The adversary sees only the*marginal*distribution of the representation, which also encodes the distribution of the label\. Enforcingpsrc​\(z\)=ptgt​\(z\)p\_\{\\mathrm\{src\}\}\(z\)=p\_\{\\mathrm\{tgt\}\}\(z\)is therefore label\-preserving only if the quantity of interest is distributed identically in the two domains,psrc​\(y\)=ptgt​\(y\)p\_\{\\mathrm\{src\}\}\(y\)=p\_\{\\mathrm\{tgt\}\}\(y\)\[[38](https://arxiv.org/html/2608.18190#bib.bib17)\]\. Otherwise the alignment can be achieved only by distorting the predictions themselves\.

In physics, neither of these assumptions typically holds\. First, simulations can be wrong about the physics itself, hence the mismatch is not a nuisance but a genuine difference in the relation between the data and the quantity of interest\. Second, in many physics applications the distribution of the target quantity is not shared between the domains, and is in fact the very thing being measured\. For example, in cosmic\-ray energy reconstruction it is the experimental energy spectrum, and in cosmology the redshift distribution\. Since the adversary cannot distinguish a nuisance difference from a difference in the distribution of the label, applying DA naively in such a case may spuriously align the experimental spectrum with the simulated one, biasing the measurement that DA was introduced to protect\.

In this paper we perform a systematic study of domain adaptation effects on a toy simulated experiment mimicking an air\-shower detector array\. The benchmark exposes three distinct types of mismatch: a misspecification of the simulated physics \(the lateral distribution function, LDF\), an artifact of the simulated detector response \(the waveform shape\), and a spectrum \(label\) shift\. We find that DA performs well as long as the two domains share the same energy spectrum\. However, once spectra are different \(label shift\), the standard domain\-adversarial neural network \(DANN\)\[[15](https://arxiv.org/html/2608.18190#bib.bib1)\]drags the reconstructed spectrum towards the simulation prior\. This introduces bias in the very quantity the analysis sets out to measure\.

To resolve this, we introduce*Adaptive Domain Adaptation*\(ADA\), which targets the label shift directly\. ADA dynamically assigns weights to the simulated events entering the adversarial loss, so that the source \(MC\) and target \(experimental data\) spectra, as estimated by the network itself, coincide\. The spectrum is thereby removed from the set of domain\-discriminative features, and the adversary is left to act only on the genuine physical difference between the domains\. Similar importance\-weighted adversarial alignment has previously been applied to classification tasks to account for class imbalance\[[38](https://arxiv.org/html/2608.18190#bib.bib17),[42](https://arxiv.org/html/2608.18190#bib.bib18)\]\. Our ADA extends this approach to the regression case, where the weights have to be inferred on the fly, in the absence of known target labels\.

Mismatches between simulation and experimental data frequently manifest across different stages of the signal processing pipeline\. We demonstrate that when a domain shift is localized, domain adaptation employing a local domain classifier effectively strips away the detector\-level nuisance\. However, when discrepancies are non\-localized or affect global event properties, such approach does not resolve the domain shift and one should use standard, global domain adaptation\.

To maximize performance when the true target spectrum is unknown, we also propose*iterative domain adaptation*\. By feeding the target spectrum predicted in one training round back into the next as an improved prior, the framework iteratively updates its spectrum assumptions\. This self\-consistent refinement mitigates reliance on poorly specified initial priors and leads to better energy spectrum reconstruction\.

Our second result addresses the question of how to select a model when no target labels exist\. Adversarial training has a free parameter, the adaptation strength, and the quality of the result may depend on it sharply\. Yet no quantity available at training time indicates whether the adaptation has succeeded, or is too weak or too strong\. We propose a label\-free selection rule based on the cross\-seed spread of the network’s predictions: model configurations whose independently seeded runs agree with one another are those in which adversarial training has properly converged\. On our toy experiment this rule returns, in every case we studied, a configuration within25%25\\%of the label\-chosen optimum\. This makes domain adaptation usable in practice in the most challenging case when no reliable target labels exist\.

The rest of the paper is structured as follows\. Section[2](https://arxiv.org/html/2608.18190#S2)introduces the toy simulated experiment, the network architecture, and the diagnostic quantities used throughout the paper\. In section[3](https://arxiv.org/html/2608.18190#S3)we consider each of the domain mismatches one at a time, to understand the role of each shift in isolation\. Section[4](https://arxiv.org/html/2608.18190#S4)switches them on together and identifies the failure modes of standard DA\. Adaptive domain adaptation, ADA, is introduced in section[4\.2](https://arxiv.org/html/2608.18190#S4.SS2)on the example of a joint LDF and spectrum mismatch\. Section[4\.3](https://arxiv.org/html/2608.18190#S4.SS3)considers the waveform\-plus\-spectrum mismatch, and section[4\.4](https://arxiv.org/html/2608.18190#S4.SS4)covers the realistic case in which all three shifts are present at once\. We formulate and verify the general label\-free model selection rule in section[5](https://arxiv.org/html/2608.18190#S5)\. Finally, section[6](https://arxiv.org/html/2608.18190#S6)concludes the paper\.

## 2Data and neural network

### 2\.1Simulated experiment and datasets

Our air\-shower detector is a3×33\\times 3grid of nine detector stations, with grid spacingD=1500D=1500m\. Eacheventis a single shower observation whose core is placed at a random core\-to\-center offset drawn uniformlyrcore∈\[200,D/3\]r\_\{\\mathrm\{core\}\}\\in\[200,D/3\]m\. The azimuth and zenith angles of the air shower are uniformly distributed in\[0,2​π\)\[0,2\\pi\)andcos⁡θ∈\[cos⁡π/4,1\]\\cos\\theta\\in\[\\cos\\pi/4,1\], respectively\. The zenith angle is a physical parameter of the event: it fixes the perpendicular distances from the stations to the shower axis, and hence the signal each station registers\. Each event is labelled by its dimensionless energyE=log10⁡\(Eph/1​EeV\)∈\[0,1\]E=\\log\_\{10\}\(E\_\{\\text\{ph\}\}/1\\text\{EeV\}\)\\in\[0,1\], and we sample energy spectra from Beta distributions\.

Each station records awaveform— a time series of the registered signal, sampled in 64 bins that uniformly cover the interval\[−5,5\]\[\-5,5\]in arbitrary time units \(a\.u\.\)\. All nine stations register a signal in every event, and no trigger condition or threshold is applied\. We assume that the waveforms have a Gaussian shape centered at their middle, with the integrated registered signalS⁡\(r,E\)S\(r,E\)following a power\-law lateral distribution function \(LDF\):

S⁡\(r,E\)=S0​\(E\)​\(rr0\)−βLDF,S0​\(E\)=100⋅10E,r0=800​m,βLDF=3\.0,S\(r,E\)\\;=\\;S\_\{0\}\(E\)\\,\\Big\(\\frac\{r\}\{r\_\{0\}\}\\Big\)^\{\-\\beta\_\{\\mathrm\{LDF\}\}\}\\,,~~~~S\_\{0\}\(E\)\\;=\\;100\\cdot 10^\{E\}\\,,~~~~r\_\{0\}=800~\\mathrm\{m\}\\,,~~~~\\beta\_\{\\mathrm\{LDF\}\}=3\.0\\,,\(2\.1\)whererris the perpendicular distance from the station to the shower axis andβLDF\\beta\_\{\\mathrm\{LDF\}\}is the LDF slope parameter\. The waveform width depends on the signal magnitude throughσ⁡\(S\)=0\.8\+0\.4​log10⁡\(1\+S\)\\sigma\(S\)=0\.8\+0\.4\\,\\log\_\{10\}\(1\+S\)a\.u\., and independent Gaussian noise of standard deviation0\.020\.02is added to each bin\. The physical information about the energy thus reaches the network through the integral of the waveform, while its shape and width are set by the simulation of the detector response\. An example of an event is shown in figure[1](https://arxiv.org/html/2608.18190#S2.F1)\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/figure_event_layout.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/figure_waveform_example.png)\(b\)

Figure 1:An example of an event\. \(a\): station locations and registered signal, \(b\): example of two waveforms registered by stations, with time axis in arbitrary units \(a\.u\.\)\.Besides the waveform samples, each station is described by four scalars: the perpendicular distance to the shower axisr/r0r/r\_\{0\}, the ground coordinates\(x,y\)/r0\(x,y\)/r\_\{0\}with respect to shower core, and the normalized plane\-front arrival timett\. In the experiments without a waveform mismatch we supply one more feature, the integral of the registered waveform, theintegral bypass\. All waveform bins and the integral charge are transformed aslog10⁡\(1\+S\)\\log\_\{10\}\(1\+S\), since they span several orders of magnitude in raw values\.

To quantify success or failure of DA, on the target domain we evaluate the mean absolute error \(MAE\) of the energy predictions and the Wasserstein\-1 distance \(WD\) between the predicted,p^tgt​\(E\)\\hat\{p\}\_\{\\mathrm\{tgt\}\}\(E\), and true target spectra,ptgttruep\_\{\\mathrm\{tgt\}\}^\{\\mathrm\{true\}\}\. WD, also known as the earth mover’s distance, is the minimal cost of transforming one distribution into the other, the cost of moving a unit of probability mass being the distance over which it is moved\. The two metrics are complementary: MAE measures the accuracy of individual events, while WD measures the accuracy of the reconstructed spectrum as a whole\. All reported metrics are averaged over five independent trainings that differ only in the initial neural network state \(random seed\)\.

In our experiments we will use three datasets, each playing a different role\.

The first dataset plays the role of the MC\-simulated events that can be used to train the neural network\. We will call it thetrainingset𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}, withntr=40 000n\_\{\\mathrm\{tr\}\}=40\\,000labelled events of thesource\(MC\) domain\. Their energy distribution is chosen to be flat,Etr∈\[0,1\]E\_\{\\text\{tr\}\}\\in\[0,1\], to reduce the energy\-dependent bias of event reconstruction and to cover the whole energy range within a single dataset\.

The second dataset is thetarget, or “experimental” dataset𝒟tgt\\mathcal\{D\}\_\{\\mathrm\{tgt\}\}withntgt=30 000n\_\{\\mathrm\{tgt\}\}=30\\,000unlabelled events, containing the events of physical interest\. In the general case, its spectrum is unknown or known only approximately, and it can differ from the source dataset in event characteristics\. For example, imperfect MC simulations and unknown high\-energy physics parameters may result in a different LDF slope, while a mis\-simulation of the detector response may result in different waveform shapes\.

The third dataset is theDA\-sourcedataset𝒟da\\mathcal\{D\}\_\{\\mathrm\{da\}\}withnda=ntgt=30 000n\_\{\\mathrm\{da\}\}=n\_\{\\mathrm\{tgt\}\}=30\\,000, which is used for domain adaptation alongside the target dataset\. It is generated with the same source\-side parameters as𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}, but its spectrum is drawn from the approximated target spectrum\. This approximates the condition under which adversarial alignment is safe\[[38](https://arxiv.org/html/2608.18190#bib.bib17)\], letting the network train over the full energy range while adaptation acts on the genuine domain shift alone\. The spectrum of𝒟da\\mathcal\{D\}\_\{\\mathrm\{da\}\}thus plays the role of the experimenter’s prior on the target spectrum\.

### 2\.2Neural network and training

Reconstructing the shower energy requires processing the data at two levels: the waveform recorded by each station, and the event as a whole, formed by all nine stations together\. Our network is organized accordingly\. A waveform encoder first summarises each station’s waveform into a compact feature vector, and a transformer then combines the per\-station information into a single event\-level representation, from which the energy is estimated\. Below we describe these two components\.

The waveform encoder is a small one\-dimensional convolutional neural network \(CNN\) that maps the 64\-bin waveform to a66\-dimensional feature vector through the sequence

\(1×64\)→conv\(8×32\)→conv\(16×16\)→conv\(16×8\)→flattenℝ128→linearℝ6,\(1\\times 64\)\\;\\xrightarrow\{\\text\{conv\}\}\\;\(8\\times 32\)\\;\\xrightarrow\{\\text\{conv\}\}\\;\(16\\times 16\)\\;\\xrightarrow\{\\text\{conv\}\}\\;\(16\\times 8\)\\;\\xrightarrow\{\\text\{flatten\}\}\\;\\mathbb\{R\}^\{128\}\\;\\xrightarrow\{\\text\{linear\}\}\\;\\mathbb\{R\}^\{6\},\(2\.2\)where\(c×ℓ\)\(c\\times\\ell\)denotesccchannels of lengthℓ\\ell\. Each convolution has kernel size55and stride22, and every layer is followed by a GELU nonlinearity\. The resulting feature vector encodes the pulse information, and the encoder is trained jointly with the rest of the network to learn the features most useful for energy reconstruction\.

The waveform feature vector is then concatenated with the scalar station characteristics: the station coordinates, the plane\-front arrival time, and, when the integral bypass is enabled, the integral charge\. A learnable linear layer maps each station vector to the model dimensiond=32d=32, producing the sequence of station representations that the rest of the network operates on\.

Transformers\[[39](https://arxiv.org/html/2608.18190#bib.bib20)\]are a natural choice for the event\-level part of the model\. Their self\-attention mechanism takes into account correlations between all stations, thus potentially enabling more accurate analysis than convolution or recurrent neural networks\. Each event is represented as an unordered set of stations, forming the input to the neural network\. We use a two\-layer transformer encoder with two attention heads and a learnable classification token\[[12](https://arxiv.org/html/2608.18190#bib.bib6)\], which we call theevent summary, aggregating the station representations into a single vector\. The event summary is read by a two\-layer fully connected regression head that outputs the estimated energy, trained with the mean\-square error onEE\. In total the network has23 50023\\,500trainable parameters\.

To make the predictions robust against the domain shift, we attach adomain\-adaptation layerto the event summary, figure[2](https://arxiv.org/html/2608.18190#S2.F2), following the DANN architecture\[[15](https://arxiv.org/html/2608.18190#bib.bib1)\]\. It comprises a domain classifier, orcritic, trained to distinguish source and target domains, and a gradient\-reversal layer \(GRL\) inserted between the classifier and the event encoder\. The event\-wise critic reads the3232\-dimensional event summary and consists of a linear layer of width3232, followed by layer normalization, a GELU nonlinearity, and a linear layer producing a single logit\. It searches for the features that best distinguish the two domains\. During backpropagation, the GRL reverses the sign of the critic’s gradient, scaled by a factorλ\\lambda, before it reaches the encoder\. The encoder is thereby driven to remove precisely the features the critic relies on\. The intended outcome is that the domain can no longer be inferred from the event summary, so that the energy is read from features shared by the two domains\.

The domain shift may also be sought at the level of individual stations rather than the whole event\. For this purpose we use a second, waveform\-wise critic, attached through its own GRL to the66\-dimensional output of the waveform encoder\. It is a linear layer of width3232, followed by a GELU nonlinearity and a linear layer producing a single logit, and it is applied to each station separately\. Both critics are trained with the binary cross\-entropy loss\. Unless stated otherwise, domain adaptation is performed with the event\-wise critic alone\.

The three datasets of section[2\.1](https://arxiv.org/html/2608.18190#S2.SS1)enter the network as two batches per training step, as shown in figure[2](https://arxiv.org/html/2608.18190#S2.F2)\. Aregression batchis drawn from the labelled training set𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}; it passes through the encoder and the regression head and contributes the energy loss\. Adomain\-adaptation batchcombines the DA\-source𝒟da\\mathcal\{D\}\_\{\\mathrm\{da\}\}and the target𝒟tgt\\mathcal\{D\}\_\{\\mathrm\{tgt\}\}in equal proportion; it passes through the encoder and the domain\-adaptation layer and contributes the domain loss\. By summing these two losses, the network jointly optimizes for accurate energy mapping via the training set and domain invariance via the unlabelled datasets\.

Optimizing this joint loss requires carefully managing the adversarial training dynamics\. The shared encoder must balance opposing updates: the standard gradient minimizing the regression loss and the reversed gradient maximizing the critic’s confusion\. We found that adaptive optimizers like Adam perform poorly under these conditions, as their coordinate\-wise scaling disproportionately amplifies the conflict between the two gradients\. Compared to our preferred optimizer, Adam degrades target recovery by a factor of three and lowers run\-to\-run robustness\. Although plain stochastic gradient descent \(SGD\) handles the gradient conflict better, it converges slowly\. To achieve stable and timely convergence, we utilize SGD with a momentum of 0\.9, which successfully damps the oscillations inherent to the adversarial loss landscape\.

Figure 2:Data flow during training and the network architecture\. The labelled training set𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}forms the regression batch \(blue\), which is processed by the transformer encoder and read by the regression head\. The DA\-source𝒟da\\mathcal\{D\}\_\{\\mathrm\{da\}\}and the target𝒟tgt\\mathcal\{D\}\_\{\\mathrm\{tgt\}\}are combined in equal proportion into the domain\-adaptation batch \(orange\), which is processed by the same encoder and read by the domain\-adaptation layer\. The two paths meet in the combined loss\.The network is trained for 60 epochs\. The adaptation strengthλ\\lambdais ramped up from zero following the standard DANN schedule\[[15](https://arxiv.org/html/2608.18190#bib.bib1)\],

λ⁡\(p\)=λmax​\(21\+e−γ​p−1\),γ=10,\\lambda\(p\)\\;=\\;\\lambda\_\{\\mathrm\{max\}\}\\left\(\\frac\{2\}\{1\+e^\{\-\\gamma p\}\}\-1\\right\),\\qquad\\gamma=10,\(2\.3\)wherep∈\[0,1\]p\\in\[0,1\]is the fraction of the training completed\. This lets the regression head learn a reasonable energy mapping before the adversarial pressure is applied, which improves the stability of the training\. The asymptotic valueλmax\\lambda\_\{\\mathrm\{max\}\}is the only free parameter of the adaptation\.

## 3Single\-axis shifts

We start by considering each of the domain mismatches separately: the simulation artifact \(waveform shape\), the physical simulation mismatch \(LDF slope\), and the energy spectrum \(label shift\)\. The true target spectrum is fixed to beBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\), figure[3\(a\)](https://arxiv.org/html/2608.18190#S3.F3.sf1), and we vary DA\-source spectrum to model the label shift\. Throughout the paper we report metrics of the model chosen by our label\-free selection rule, which is formulated in section[5](https://arxiv.org/html/2608.18190#S5), when all of the ingredients for mitigating complex domain shifts are in place\.

### 3\.1Warm\-up: a waveform\-shape mismatch

We begin with a mismatch in the recorded waveform shape, a simulation artifact of the detector response\. The source and target share the energy spectrum and the lateral distribution function, and differ only in the pulse shape: Gaussian in the source and Laplacian in the target, figure[3\(b\)](https://arxiv.org/html/2608.18190#S3.F3.sf2)\. In both cases, the integral of the pulse is the same, making the shape a nuisance parameter\. The network has to learn to read out the waveform integral in a domain\-invariant way, which is a classical DANN application, allowing us to demonstrate how it works on a simple physical example\.

A neural network trained on the labelled source𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}alone, to which we will refer as theno\-DA baseline, reconstructs the source energy accurately: its mean absolute error on the source domain isMAEsrc=0\.005\\mathrm\{MAE\}\_\{\\mathrm\{src\}\}=0\.005\. Its predictions on the target, however, are biased\. The reconstructed spectrum is shifted away from the truth,WDtgt=0\.055\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.055, and the per\-event error grows tenfold,MAEtgt=0\.054\\mathrm\{MAE\}\_\{\\mathrm\{tgt\}\}=0\.054\. The reference point for these numbers is thematched\-domain floor— the value a metric takes when the target is generated with the same parameters as the source\. It is set by the detector noise and by the resolution of the reconstruction, and no adaptation can bring a metric below it\. Here the floor isWD=0\.003,MAE=0\.0054\\mathrm\{WD\}=0\.003,~\\mathrm\{MAE\}=0\.0054, so the baseline sits almost twenty times above it\.

The bias arises because the network reads the energy from features that are specific to the source pulse shape\. It may rely on the peak height, on the pulse width, or on any other combination of the samples that reproduces the integral on the source data, and which of them a particular training settles on is not reproducible from run to run\. What matters is not the identity of these features but the fact that they are domain\-specific, so that their reading does not carry over to the target domain\.

The pulse shape is exactly the kind of nuisance the domain\-adaptation layer is designed to suppress\. The energy is carried by the integrated charge, which the two domains share, while the shape is all that separates them\. The critic can thus tell source from target only through the shape, and the gradient\-reversal layer drives the encoder to discard it, leaving a shape\-invariant reading of the integrated charge\. With the domain\-adaptation loss switched on,λ=0\.05\\lambda=0\.05, the bias vanishes: the target recovery improves toWDtgt=0\.005\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.005, near the matched\-domain floor, and the per\-event error toMAEtgt=0\.008\\mathrm\{MAE\}\_\{\\mathrm\{tgt\}\}=0\.008, figure[3\(c\)](https://arxiv.org/html/2608.18190#S3.F3.sf3)\. For this simple case DA works over a wide range ofλ\\lambda, from0\.0050\.005to0\.050\.05\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/figure_beta_spectra.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/figure_warmup_waveform.png)\(b\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/figure_warmup_spectrum.png)\(c\)

Figure 3:\(a\)The true target spectrum,Beta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\), and theBeta⁡\(4,6\)\\mathrm\{Beta\}\(4,6\)spectrum used for the DA\-source where a label shift is present\.\(b\)A source \(Gaussian\) and target \(Laplacian\) waveform carrying the same integrated charge but a different pulse shape\.\(c\)The true target spectrum and the target spectrum reconstructed without domain adaptation \(baseline\) and with DANN\.
### 3\.2Physics mismatch: LDF slope

Another source of domain shift is a physics\-related mismatch in MC simulations\. For example, unknown high\-energy physics may lead to a systematic, energy\-dependent mismatch in the LDF — how the deposited integrated charge depends on the distance from the station to the shower core\. In this section we model this situation by holding the source slope fixed, while letting the target slope grow with energy:

βsrc=3\.0,βtgt​\(E\)=3\.0\+0\.5​E\.\\beta\_\{\\mathrm\{src\}\}=3\.0\\,,~~~\\beta\_\{\\mathrm\{tgt\}\}\(E\)=3\.0\+0\.5\\,E\\;\.\(3\.1\)As a result, high\-energy target\-domain air\-showers concentrate their signal nearer the axis than source\-domain air\-showers of the same energy\. Both domains draw from the trueBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)spectrum, so no label shift is present\. In DA terminology, we are considering a parametric conditional shift inP⁡\(x∣E\)P\(x\\mid E\), parametrized by the LDF slope parameter\.

A network trained on the labelled source learns the energy\-to\-signal map implied by the source physics, and reads every target event through it\. Because the target LDF is steeper, the high\-energy showers — where the slope gap is widest — are mis\-read the hardest\. The predicted target spectrum is therefore expected to be compressed toward its low\-energy bulk\. We measure the compression by the calibration slope on the target domain,

κ=cov⁡\(E^,E\)/var⁡\(E\),\\kappa\\;=\\;\\mathrm\{cov\}\(\\hat\{E\},E\)\\,/\\,\\mathrm\{var\}\(E\)\\,,\(3\.2\)which equals unity for a faithful reading and tends to zero for a prediction collapsed onto a constant\. The no\-DA baseline hasκ=0\.49\\kappa=0\.49andWDtgt=0\.143\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.143, more than an order of magnitude above the matched\-domain floor\.

How can domain adaptation mitigate such a domain shift? To answer this question, recall that each event is registered by nine stations, at different distancesrrfrom the axis\. The energy enters every station through the common amplitudeS0​\(E\)S\_\{0\}\(E\), and the slope through a common power law inrr\. The functional dependence of signal on distance across the event therefore over\-determines the pair\(E,β\)\(E,\\beta\)\. A network that learns this dependence can recover the energy in a slope\-independent way\.

Domain adaptation is what drives the encoder onto that reading\. By its very definition, the reversed\-gradient loss penalises any feature whose distribution differs between source and target\. The source\-LDF amplitude pattern is such a feature, and it is the most direct route to a source\-only fit, so it is the first to be suppressed\. The slope\-tolerant regression draws a smaller penalty from the critic and survives\. The adversarial loss, however, is not the only term acting on the encoder\. The regression loss is applied to the same weights and requires the energy to remain readable, so the training settles at a compromise: a domain\-discriminative feature is removed only insofar as the regression can afford to lose it\. Features that separate the domains but are needed to read the energy are preserved, and we return to the consequences of this below\.

The parameterλ\\lambdaof the gradient\-reversal layer controls how strongly the adversary pushes relative to the regression loss\. Too weak aλ\\lambdaleaves the source\-LDF reading in place, and the target energy predictions stay biased\. Across a broad window,λ≈0\.04\\lambda\\approx 0\.04–0\.090\.09, the recovery is near\-complete and stable\. At the optimal point it reachesκ=0\.97\\kappa=0\.97andWDtgt=0\.014\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.014, a factor\-of\-ten improvement over the no\-DA baseline, figure[4\(a\)](https://arxiv.org/html/2608.18190#S3.F4.sf1)\. At largerλ\\lambdathe predictions start to diverge from the true target spectrum, and the spread between trainings with different random seeds grows, figure[4\(b\)](https://arxiv.org/html/2608.18190#S3.F4.sf2)\. These training\-to\-training fluctuations are the reason why the reported metrics are averaged over several seeds\.

We observed that the critic’s own loss does not flag whether domain adaptation was successful or not\. In both cases, the loss saturates atln⁡2\\ln 2, the value corresponding to indistinguishable domains\. Thus, optimal adaptation strength cannot be chosen from the adversarial loss alone\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/figure_tc1_spectra.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/figure_tc1_seedspread.png)\(b\)

Figure 4:Pure lateral\-distribution mismatch\.\(a\)The predicted target spectrum with no adaptation and with DANN at the adopted recipe, against the trueBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)target\.\(b\)Per\-seed predicted target spectra at the optimalλ\\lambdaand at a poorly\-chosen \(too\-large\)λ\\lambda\.The considered case reveals that successful DA does not imply that the source and target representations become indistinguishable by the end of the training\. Although the critic saturates at a loss ofln⁡2\\ln 2, a logistic regression freshly fitted to the frozen event\-summary vectors does learn to separate the domains\. We fit it on one half of the source and target events and quote its accuracy on the other half\. For the no\-DA baseline it reachesLRacc=83%\\mathrm\{LR\}\_\{\\mathrm\{acc\}\}=83\\%, while for the optimal DA configuration the accuracy*rises*to94%94\\%\. This is not a failure of the training, but the compromise between energy reconstruction and domain adaptation goals at work\. To recover the energy slope\-tolerantly, the encoder must read the local shape of the LDF, so the latents necessarily carry the slope, and with it the domain\. A literally domain\-invariant representation is neither what the physics permits nor what it needs\. What adaptation makes invariant is the*prediction*— the encoder and the regression head learn to use the slope to infer the right energy in both domains\.

### 3\.3Label shift: an energy\-spectrum mismatch

We now consider a pure*label shift*: the source and target share the detector responseP⁡\(x∣E\)P\(x\\mid E\), and only their energy spectra differ\. This corresponds to the situation in which simulations perfectly reproduce real experimental conditions, while the quantity of interest — the energy spectrum in our case — is unknown or known only very approximately\. We draw the DA\-source dataset fromBeta⁡\(4,6\)\\mathrm\{Beta\}\(4,6\), while the target keeps the trueBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)spectrum and the labelled training set stays flat\.

Since there is no physical mismatch, the no\-DA baseline learns the correct mapping from detector responses to energy labels on the training data\. Hence it reconstructs a target event as accurately as a DA\-source event: the physics is identical, and the network only interpolates\. Without adaptation it reachesWDtgt=0\.003\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.003, at the matched\-domain floor\.

Enabling domain adaptation degrades the predictions\. The only quantity that separates the two domains is the energy spectrum, so the critic reads the spectrum as the domain\-discriminating feature, and the gradient\-reversal layer drives the encoder to make the encoded energy indistinguishable between the domains\. This pull is opposed by the regression loss, which fixes the correct energy mapping over the whole energy range of the training dataset\. At the equilibrium point the predictions end up slightly shifted towards the DA\-source spectrum, which introduces a bias\. The distortion grows withλ\\lambda: atλ=0\.05\\lambda=0\.05the target distance is four times the floor,WDtgt=0\.009\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.009\. Forλ≥0\.15\\lambda\\geq 0\.15the training collapses — the adversarial pressure overwhelms the regression head, the source error grows by an order of magnitude, and the predicted energies lose any relation to the true ones\. Under a pure label shift, therefore, the correct action is not to adapt at all\.

This result naturally raises the question of how to identify if domain adaptation is needed\. The difficulty is that the energy spectrum is a domain\-discriminative feature by itself, so a difference in any diagnostic quantity — the similarity of the event summaries across the domains, for instance — may be caused by the spectrum alone\. Moreover, since the network is trained on the simulated source data, it may map the target events onto the same manifold the source events live on, thus hiding a difference that is in fact present\.

To avoid these traps, we use a test following the logic of foundation models\[[12](https://arxiv.org/html/2608.18190#bib.bib6)\]\. We train an autoencoder on the source domain only: the event encoder of section[2\.2](https://arxiv.org/html/2608.18190#S2.SS2)is followed by a decoder that reconstructs the full event — all per\-station characteristics, including waveform encodings — from the event summary, with the mean\-square error as the reconstruction loss\. The trained autoencoder is then applied to the target domain, and we compare the reconstruction error there with the error on held\-out source events\. If the ratio of the two is close to unity, the target events lie on the same manifold as the source events, and the domain shift, if present, is minimal\. A genuine shift of the detector response or of the physics pushes the target off that manifold, and the error rises sharply\. Across the three single\-axis cases the target\-to\-source ratio is1\.01\.0for the spectrum shift of this section, and approximately2020for the LDF and waveform shifts of sections[3\.2](https://arxiv.org/html/2608.18190#S3.SS2)and[3\.1](https://arxiv.org/html/2608.18190#S3.SS1), respectively\. A simple threshold therefore separates the mismatches that call for adaptation from the label shift, which does not\.

## 4Compound shifts

A discrepancy between simulation and data is rarely confined to one axis\. We now switch the shifts on together — first in pairs, then all three at once\. When the two mismatches are both conditional \(LDF and waveform shifts\), section[4\.1](https://arxiv.org/html/2608.18190#S4.SS1), standard domain adaptation recovers the target spectrum\. However, once there is an energy spectrum mismatch, standard domain adaptation fails\. Sections[4\.2](https://arxiv.org/html/2608.18190#S4.SS2)and[4\.3](https://arxiv.org/html/2608.18190#S4.SS3)consider these cases and introduce the solution — adaptive domain adaptation\. In section[4\.4](https://arxiv.org/html/2608.18190#S4.SS4)we consider all three mismatches together\.

### 4\.1Waveform and LDF slope mismatch

We start with the two conditional shifts acting together: a waveform shift, with Gaussian pulses in the source and Laplacian in the target, and an LDF slope mismatch, withβtgt​\(E\)=3\.0\+0\.5​E\\beta\_\{\\mathrm\{tgt\}\}\(E\)=3\.0\+0\.5\\,E\. Both energy spectra are held atBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)\.

The no\-DA baseline compresses the target energy predictions, with a calibration slope ofκ=0\.53\\kappa=0\.53and a per\-event error ofMAEtgt=0\.15\\mathrm\{MAE\}\_\{\\mathrm\{tgt\}\}=0\.15\. Both mismatches contribute to this: the steeper target LDF makes the network under\-read the high\-energy showers, while the sharper target pulse carries the same integrated charge in a different distribution of the samples\.

A single critic attached to the event summary mitigates the domain shift\. Across a broad window of the adaptation strength,λev≈0\.005\\lambda\_\{\\mathrm\{ev\}\}\\approx 0\.005–0\.020\.02, the recovered spectrum spans the true energy range and varies little between random seeds\. At the optimal configuration,λev=0\.01\\lambda\_\{\\mathrm\{ev\}\}=0\.01, it reachesκ=0\.84\\kappa=0\.84,MAEtgt=0\.065\\mathrm\{MAE\}\_\{\\mathrm\{tgt\}\}=0\.065andWDtgt=0\.009\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.009\. The remaining bias is most pronounced for highest\-energy showers, where both mismatches are strongest\.

One might expect that adding a per\-station waveform critic would improve on this, since the pulse\-shape mismatch originates at exactly that level\. This is not the case\. The two critics come with two independent reversal strengths,λev\\lambda\_\{\\mathrm\{ev\}\}andλst\\lambda\_\{\\mathrm\{st\}\}\. On this two\-dimensional grid the best configuration hasλst=0\.0\\lambda\_\{\\mathrm\{st\}\}=0\.0, indicating that two critics might be in conflict, or that a single event critic is enough\.

To identify which of the possibilities is the correct one, we tested two different critic architectures: an entangled configuration and a disentangled scheme\. In the default entangled configuration, both the event critic and the waveform critic gradients are allowed to propagate back to the waveform encoder\. In the contrasting disentangled scheme, we blocked the gradient of the event critic to the waveform encoder, forcing the per\-station representation to be shaped by the waveform critic alone\. Testing the disentangled scheme resulted in a degradation ofWDtgt\\text\{WD\}\_\{\\text\{tgt\}\}by a factor of three \(figure 4a\)\. To understand why, note that the station critic reads only the output of the waveform encoder, so it is blind to the distancerr\. This suffices for a genuine nuisance, as in section[3\.1](https://arxiv.org/html/2608.18190#S3.SS1), where the two pulse shapes carried the same integrated charge and suppressing the shape left the energy untouched\. An LDF mismatch is not of that kind: at fixed energy the target amplitude differs from the source one by a factor\(r/r0\)−Δ​β\(r/r\_\{0\}\)^\{\-\\Delta\\beta\}, so the same recorded amplitude corresponds to different energies in the two domains\. The per\-station difference is thus not a nuisance but anrr\-dependent physics mismatch\.

The event summary, in contrast, holds the amplitudes of all nine stations together with their distances, so the slope\-tolerant reading of section[3\.2](https://arxiv.org/html/2608.18190#S3.SS2)remains available to a critic acting on it\. This is the main result of this section: when several conditional shifts act at once, a single critic that sees all of them is preferable to several specialized ones\. A critic confined to one level cannot tell a nuisance from a genuine difference, and thus can be fooled into false domain\-invariance\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/spectra_panel_a.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/spectra_panel_b.png)\(b\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/spectra_panel_c.png)\(c\)

Figure 5:Reconstructed target spectra against the trueBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)target\.\(a\)Waveform and LDF mismatch with matched spectra, DA\-source and target bothBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\): single event critic and disentangled two\-critic scheme\.\(b, c\)LDF and spectrum mismatch, true targetBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)and DA\-sourceBeta⁡\(3,5\)\\mathrm\{Beta\}\(3,5\), at LDF slope\+0\.5​E\+0\.5E\(b\) and−0\.2​E\-0\.2E\(c\), comparing ADA and DANN predictions\.
### 4\.2LDF slope and spectrum mismatch

We proceed with combined LDF slope and energy spectrum mismatches, that is, a physical and a label shift acting together\. The DA\-source LDF slope is fixed toβsrc=3\.0\\beta\_\{\\mathrm\{src\}\}=3\.0, while the target slope changes with energy asβtgt​\(E\)=3\.0\+α​E\\beta\_\{\\mathrm\{tgt\}\}\(E\)=3\.0\+\\alpha E\. The target keeps the trueBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)spectrum, while the DA\-source is drawn fromBeta⁡\(4,6\)\\mathrm\{Beta\}\(4,6\)\. Below we first examine the default configuration,α=0\.5\\alpha=0\.5, and then sweep both the slope and the DA\-source spectrum to map out the behaviour of the methods\.

A neural network trained without DA pulls the target energy spectrum to the low\-energy tail\. The Wasserstein distance between the true and the predicted spectrum isWDtgt=0\.143\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.143, with a calibration slope ofκ=0\.49\\kappa=0\.49and a predicted target mean of0\.140\.14against the true0\.2860\.286\. This is more than an order of magnitude above the matched\-domain floor ofWD=0\.003\\mathrm\{WD\}=0\.003\.

A standard DANN fails in this regime\. Across allλ\\lambdavalues it over\-corrects on average, at best reachingWDtgt=0\.14\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.14andκ=1\.22\\kappa=1\.22\. The distance to the true spectrum is thus no better than that of the no\-DA baseline, while the failure mode is inverted: the baseline compresses the predicted spectrum, and DANN stretches it\.

The underlying reason why DANN fails is that the LDF slope and the energy spectrum mismatches are entangled, with no clear way to separate them\. Specifically, the critic’s gradient on the encoder is a sum of two pulls\. The first drives the encoder toward LDF\-tolerant features, which is useful\. The other drives it toward an energy\-distribution\-invariant representation, which is harmful, since it explicitly aligns the energy spectra of the two domains\. What is different from the pure label shift of section[3\.3](https://arxiv.org/html/2608.18190#S3.SS3)is that the second pull is no longer resisted\. There the two domains were physically identical, so distorting the target predictions meant distorting the same mapping that the regression loss was fixing on the labelled training set, and the regression head held the predictions in place\. Here the target events genuinely look different, and the encoder can move their predictions without influencing the source regression loss\. The anchor is gone, the training is ill\-posed, and the predictions are unreliable\.

To resolve this, one should stop the adversary from seeing the spectrum at all, so that it can act only on the genuine domain difference — the LDF response\. If the DA\-source and the target carried the same energy spectrum, their predicted\-energy marginals would already coincide, and the critic could no longer read the spectrum as a domain feature\. Whatever separation it then finds is the physical shift we actually want it to remove\. This is the condition under which adversarial alignment is known to be safe\[[38](https://arxiv.org/html/2608.18190#bib.bib17)\]\. The spectrum difference can be cast out of the DA loss by reweighting the DA\-source events so that the two domains have the same effective \(weighted\) spectrum\. The question then becomes how to find weights such that the reweighted DA\-source spectrum is a faithful approximation of the target spectrum\.

We approach this problem as follows\. The DA\-source spectrum is considered as a prior of the true target energy spectrum, which is updated after each epoch of neural network training\. This correction is done via assigning weights to DA\-source events so that effective spectra, estimated by the neural network, of DA\-source and target events are the same\. Specifically, after each training epoch we bin the predicted source and target energy spectra intoBBuniform bins on\[0,1\]\[0,1\]and assign to a DA\-source event whose predicted energy falls in binbbthe weight

wb=p^tgt​\(b\)p^da​\(b\),w\_\{b\}\\;=\\;\\frac\{\\hat\{p\}\_\{\\mathrm\{tgt\}\}\(b\)\}\{\\hat\{p\}\_\{\\mathrm\{da\}\}\(b\)\}\\;,\(4\.1\)wherep^⋅​\(b\)\\hat\{p\}\_\{\\mathrm\{\\cdot\}\}\(b\)is the fraction of events of the corresponding domain falling into binbb\. We further clip values to range of\(0\.01,30\)\(0\.01,30\)to avoid training instabilities due to exploding weights\. This removes the energy\-spectrum difference from the DA loss, forcing the critic to search for the genuine domain shift\. The weights are updated after each epoch, so the network converges to a fixed point at which the weights stop changing\.

We dub this approach*Adaptive Domain Adaptation*\(ADA\), summarised in algorithm[1](https://arxiv.org/html/2608.18190#alg1)\. It is similar in spirit to importance\-weighted DANN for classification tasks\[[38](https://arxiv.org/html/2608.18190#bib.bib17),[42](https://arxiv.org/html/2608.18190#bib.bib18),[35](https://arxiv.org/html/2608.18190#bib.bib4),[28](https://arxiv.org/html/2608.18190#bib.bib5)\]\. The difference is that ADA generalizes the approach to the regression case, when the predictions are themselves affected by the very shift being corrected\. Note that ADA is self\-referential: it assigns weights to events based on its own predictions\. We will see in the sweep below that this leaves a visible imprint on the results, without preventing ADA from bounding the error where standard DA does not\.

Algorithm 1Adaptive Domain Adaptation \(ADA\)\.1:Labelled source

𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}, DA\-source

𝒟da\\mathcal\{D\}\_\{\\mathrm\{da\}\}\(unlabelled, source physics, arbitrary energy spectrum\), target

𝒟tgt\\mathcal\{D\}\_\{\\mathrm\{tgt\}\}\(unlabelled, target physics\)

2:Number of energy bins

BB, EMA decay

η\\eta, epochs

NN
3:Initialise per\-bin weights

wb\(0\)←1w\_\{b\}^\{\(0\)\}\\leftarrow 1
4:for

k=1k=1to

NNdo

5:Train the neural network for one epoch on

𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}for regression, and on

𝒟da\\mathcal\{D\}\_\{\\mathrm\{da\}\}with weights

w\(k−1\)w^\{\(k\-1\)\}and

𝒟tgt\\mathcal\{D\}\_\{\\mathrm\{tgt\}\}for domain adaptation\.

6:At epoch end, get normalized histograms of predicted energy

E^\\hat\{E\}on source and target domains:

p^tgt←hist⁡\(E^​\(𝒟tgt\)\)\\hat\{p\}\_\{\\mathrm\{tgt\}\}\\leftarrow\\mathrm\{hist\}\(\\hat\{E\}\(\\mathcal\{D\}\_\{\\mathrm\{tgt\}\}\)\),

p^da←hist⁡\(E^​\(𝒟da\)\)\\hat\{p\}\_\{\\mathrm\{da\}\}\\leftarrow\\mathrm\{hist\}\(\\hat\{E\}\(\\mathcal\{D\}\_\{\\mathrm\{da\}\}\)\)
7:Update source\-event weights:

w~b←p^tgt​\(b\)/p^da​\(b\)\\tilde\{w\}\_\{b\}\\leftarrow\\hat\{p\}\_\{\\mathrm\{tgt\}\}\(b\)/\\hat\{p\}\_\{\\mathrm\{da\}\}\(b\)
8:\(optional\) Use EMA to reduce oscillations:

wb\(k\)←η​w~b\+\(1−η\)​wb\(k−1\)w\_\{b\}^\{\(k\)\}\\leftarrow\\eta\\,\\tilde\{w\}\_\{b\}\+\(1\-\\eta\)\\,w\_\{b\}^\{\(k\-1\)\}
9:endfor

10:returntrained encoder and regressor, final ADA weights

To test ADA, we compare it against standard domain adaptation \(DANN\), varying two parameters\. The first is the LDF slope coefficientα\\alpha, taking the valuesα∈\{0\.5,0\.2,−0\.2\}\\alpha\\in\\\{0\.5\\,,0\.2\\,,\-0\.2\\\}\. This covers a strong and a mild domain shift, while the change of sign reverses the direction of the bias\. For positive \(negative\)α\\alphathe signal falls faster \(slower\) with distance, resulting in underestimation \(overestimation\) of the energy according to the DA\-source physics model\. The second parameter is the difference between the mean energies of the DA\-source and target spectra, which we vary from−0\.1\-0\.1to0\.30\.3by changing the parameters of the Beta distribution the DA\-source is drawn from\. We useB=10B=10bins, so that each energy bin hasn≥10n\\geq 10events, and an exponential moving average \(EMA\) of the weights with decay0\.30\.3, which damps their oscillations from epoch to epoch\. Both values were chosen for the stability of the training, including the stability of the weight updates themselves\.

Figures[5\(b\)](https://arxiv.org/html/2608.18190#S4.F5.sf2)and[5\(c\)](https://arxiv.org/html/2608.18190#S4.F5.sf3)compare ADA and DANN predictions for the fixed DA\-source spectrumBeta⁡\(3,5\)\\mathrm\{Beta\}\(3,5\)\(mean difference\+0\.09\+0\.09\) and different\-sign LDF slope mismatches,α∈\{0\.5,−0\.2\}\\alpha\\in\\\{0\.5,\-0\.2\\\}\. Forα=0\.5\\alpha=0\.5, DANN pulls the prediction towards the DA\-source spectrum and over\-reads, while ADA stays close to the target, whereas at−0\.2​E\-0\.2Ethe two nearly coincide\.

The Wasserstein distance as the function of DA\-source and target spectra difference is shown in figure[6](https://arxiv.org/html/2608.18190#S4.F6)\. DANN outperforms ADA in a narrow band where the DA\-source spectrum is close to the true target, which lets DANN concentrate on the genuine domain mismatch, while ADA’s weights fluctuate, which are further injected into the adversarial loss\. At matched spectra DANN reachesWDtgt=0\.008\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.008–0\.0300\.030across the three slopes, against ADA’sWDtgt≈0\.05\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}\\approx 0\.05\. At larger spectrum differences ADA performs better — at a spectrum\-mean difference of0\.30\.3the DANN error grows toWDtgt≈0\.09\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}\\approx 0\.09–0\.290\.29, while ADA stays nearWDtgt=0\.03\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.03–0\.090\.09\. This illustrates that ADA is preferable when the true target spectrum is known only approximately, substantially reducing the prediction bias of standard DA\.

Note that ADA behaves differently for positive and negativeα\\alpha\. For positiveα\\alphathe error decreases with the spectrum difference, from0\.0780\.078to0\.0460\.046at\+0\.5​E\+0\.5E\. The LDF mismatch makes the network underestimate event energies, so reweighting the DA\-source towards higher energies moves the predicted spectrum back towards the truth\. For negativeα\\alphathe situation is reversed\. The network overestimates the energy, which raises the ADA weights for high\-energy events, which in turn reinforces the overestimation, and the error grows from0\.050\.05to0\.090\.09at−0\.2​E\-0\.2E\. This is the self\-referential estimate of the weights at work, and it is the price of inferring the target spectrum from the predictions of the very network being corrected\. Even in the latter case, however, the loop does not run away: ADA remains stable and yields a reasonable estimate of the true target spectrum\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/slope_panel_a.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/slope_panel_b.png)\(b\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/slope_panel_c.png)\(c\)

Figure 6:Target per\-event errorMAEtgt\\mathrm\{MAE\}\_\{\\mathrm\{tgt\}\}against the DA\-source−\-target spectrum\-mean difference, for event ADA and DANN with the no\-adaptation baseline, at LDF slope\(a\)\+0\.5​E\+0\.5E,\(b\)\+0\.2​E\+0\.2Eand\(c\)−0\.2​E\-0\.2E\. Each operating point is chosen by the label\-free rule of section[5](https://arxiv.org/html/2608.18190#S5); bands are±1\\pm 1std over the seeds\.To summarise, when a physical and a label shift act together, standard domain adaptation is unsafe at every adaptation strength\. Specifically, it biases the predictions in an uncontrolled, mismatch\-dependent way\. Removing the spectrum from the adversary’s view repairs this\. ADA keeps the error bounded across the whole range of spectrum mismatches we scanned, at the cost of a modest floor in the regime where the assumed spectrum happens to be correct\. In section[4\.4](https://arxiv.org/html/2608.18190#S4.SS4)we will see how ADA’s predictions can be improved further\.

### 4\.3Waveform and spectrum shift

The last pair to switch on combines the waveform\-shape shift with a spectrum shift, holding the LDF slope fixed\. The source pulses are Gaussian and the target pulses Laplacian, carrying the same integrated charge at the same energy\. As in section[4\.2](https://arxiv.org/html/2608.18190#S4.SS2), the DA\-source and the target draw their energies from differentBeta\\mathrm\{Beta\}spectra, and we vary the difference between their means\.

The two mismatches enter the problem in different ways\. The waveform shape is the only genuine domain shift: it differs between the domains and must be corrected\. The spectrum difference, on the other hand, does not require correction by itself — a neural network trained in a domain\-invariant way would reconstruct it correctly\. The spectrum becomes a problem only because the adversary sees it and treats it as a domain feature\. Disentangling the two — letting the adversary act on the genuine mismatch alone — should therefore make the label harmless, and give ADA a better recovery\. These motivate the two approaches tested below\.

The first follows the logic of foundation models\[[12](https://arxiv.org/html/2608.18190#bib.bib6)\], which are widely expected to be robust against domain shift because their representations are learned from the data alone, without a task label to over\-specialize on\. We test this expectation in combination with domain adaptation\. The waveform encoder is trained first, on its own, with standard domain adaptation and no energy labels\. Having never seen the spectrum, it cannot encode it, and the pulse\-shape difference is the only thing its critic can act on\. The encoder is then frozen, and the rest of the network is trained on top of it to reconstruct the energy\. We call this the*staged domain adaptation*approach\.

The second approach keeps the network end\-to\-end but localizes the critic to the level at which the mismatch actually lives\. Here the critic is attached to the output of the waveform encoder and acts on each station separately, with the ADA weight of an event propagated to all of its stations\. Section[4\.1](https://arxiv.org/html/2608.18190#S4.SS1)found a station critic to be harmful, but the situation there was different\. The waveform shift was accompanied by an LDF mismatch, which is not visible in a single station and thus fools it to wrong domain\-invariance\. Here the accompanying mismatch is the spectrum, which ADA has already removed from the critic’s view, and the pulse shape that remains is a genuine nuisance\. We further refer to this approach as waveform ADA, and to the end\-to\-end scheme with an event\-wise critic as event ADA\.

The results are presented in figure[7](https://arxiv.org/html/2608.18190#S4.F7)\. The no\-adaptation baseline reachesWDtgt=0\.057\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.057\. Near matched spectra, event ADA and staged DA perform best, reachingWDtgt≈0\.01\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}\\approx 0\.01, well below the no\-DA baseline\. Their error grows as the spectrum difference widens, reachingWDtgt=0\.10\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.10–0\.230\.23at a difference of0\.30\.3\. Waveform ADA behaves oppositely: it stays nearWDtgt=0\.035\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.035across the whole range, but pays a higher floor at small spectrum shifts, where the other two are better\. The calibration slope stays close to unity,κ≈1\.0\\kappa\\approx 1\.0–1\.051\.05, for all three throughout, so none of them distorts the shape of the spectrum\. Standard DANN, shown for reference, matches these methods only near coincident spectra and, as in the other compound cases, loses reliability as the spectra diverge\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/wfspec_panel_a.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/wfspec_panel_b.png)\(b\)

Figure 7:Waveform\-plus\-spectrum mismatch for event ADA, DANN, staged DA, and waveform ADA with the no\-adaptation baseline, against the difference between the DA\-source and target spectrum means:\(a\)the target recoveryWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}and\(b\)the calibration slopeκ\\kappa\.Staged DA metrics become worse at large mismatch for a definite reason: the waveform encoder is de\-nuisanced against a source whose spectrum is already wrong, and that bias passes into the readout trained on top of it\. This suggests the fix\. A trained model already estimates the target spectrum better than the guess it started from, so one can feed that estimate back as the DA\-source prior and repeat\. The loop is then iterated until the feed\-in and final energy spectra agree\. We call this*iterative domain adaptation*\. For staged DA the refined prior enters at the first stage, where the waveform encoder is re\-trained against a source whose spectrum matches the target more closely\.

Figure[8](https://arxiv.org/html/2608.18190#S4.F8)shows the effect for three DA\-source spectra spanning mean differences of\+0\.11\+0\.11to\+0\.31\+0\.31\. A single pass over\-reads, the more so the larger the mismatch, but one or two rounds of refinement bring all three to the matched\-spectrum floor ofWDtgt≈0\.01\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}\\approx 0\.01, well below the no\-DA baseline of0\.0570\.057\.

With this refinement, staged DA is the most accurate method for a combined waveform\-and\-spectrum mismatch, reaching its matched\-spectrum performance at any spectrum prior\. Waveform ADA lags a little behind, holdingWDtgt≈0\.035\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}\\approx 0\.035across the whole range\. Note that its metrics are flat across the whole mean\-energy\-difference range, with a higher floor than staged DA at the matched spectrum\. This implies that waveform DA does not benefit from iterative domain adaptation\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/iterstaged_panel_a.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/iterstaged_panel_b.png)\(b\)

Figure 8:Iterative domain adaptation applied to staged DA\.\(a\)Target recoveryWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}against the iteration round, for three DA\-source spectra at mean differences\+0\.11\+0\.11,\+0\.21\+0\.21and\+0\.31\+0\.31\.\(b\)Predicted target spectra across rounds for the largest mismatch,Δ=\+0\.31\\Delta=\+0\.31\.
### 4\.4All shifts at once: the realistic case

We now consider the realistic case, in which all three domain shifts are present at once: the waveform mismatch \(detector response\), the energy\-spectrum \(label\) shift, and the LDF slope \(physical\) mismatch\. As in the previous cases, we take the energy\-dependent slopeβtgt=3±0\.2​E\\beta\_\{\\mathrm\{tgt\}\}=3\\pm 0\.2\\,Eand sweep the difference between the DA\-source and target spectrum means\. The target spectrum isBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\), the labelled source is flat, and the pulses are Gaussian in the source and Laplacian in the target\.

In this case the two conditional shifts — of the LDF slope and waveform shape — are present and entangled\. As it was demonstrated in section[4\.1](https://arxiv.org/html/2608.18190#S4.SS1), under such conditions a single critic performs better than two dedicated ones\. This logic also excludes staged DA as a viable option for the triple mismatch case\. Hence the only available option is ADA, which we compare against standard DANN\.

The results are presented in figure[9](https://arxiv.org/html/2608.18190#S4.F9)for different DA\-source—target spectrum\-mean differences at both slopes, withMAEtgt\\mathrm\{MAE\}\_\{\\mathrm\{tgt\}\}following the same trend\. The no\-adaptation baseline lies atWDtgt=0\.08\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.08\(\+0\.2​E\+0\.2E\) and0\.070\.07\(−0\.2​E\-0\.2E\)\. The two methods, ADA and DANN, agree only near matched spectra, where both recover the target and DANN is marginally better\. As the assumed DA\-source spectrum departs from the target, DANN degrades rapidly — at the largest mismatch its error reaches several times the baseline — because it anchors the target predictions on that assumed spectrum\. ADA is more robust, changing only slowly across the sweep, which makes it the safer choice whenever the spectrum prior is imperfect\. The reversed slope is the hardest setting, where the over\-reading bias established in section[4\.2](https://arxiv.org/html/2608.18190#S4.SS2)compounds the spectrum mismatch: there even ADA rises toWDtgt≈0\.12\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}\\approx 0\.12at the largest mismatch\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/triple_panel_a.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/triple_panel_b.png)\(b\)

Figure 9:Target recoveryWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}against the DA\-source—target spectrum\-mean difference for event ADA and DANN for the triple mismatch at LDF slope\(a\)\+0\.2​E\+0\.2Eand\(b\)−0\.2​E\-0\.2E\.The single\-pass comparison above assumes a fixed DA\-source spectrum, but the iterative domain adaptation of section[4\.3](https://arxiv.org/html/2608.18190#S4.SS3)carries over to ADA: we feed each run’s predicted target spectrum back as the DA\-source prior and repeat\. Figure[10](https://arxiv.org/html/2608.18190#S4.F10)shows the outcome at both slopes, and the gain is largest where the mismatch is largest\. For the badly\-chosenBeta⁡\(3,2\)\\mathrm\{Beta\}\(3,2\)DA\-source at LDF slope−0\.2​E\-0\.2E, a single pass reaches onlyWDtgt=0\.113\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.113, yet a few rounds drive it down to0\.0450\.045\.

Iterative ADA behaves differently for positive and negative LDF slope corrections\. At\+0\.2​E\+0\.2Ewith a flat DA\-source, where a single pass already reads the spectrum well, feeding its slightly under\-read prediction back as the prior mildly reinforces the under\-reading\. As a result, the error slightly drifts up across rounds, but only fromWDtgt=0\.055\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}=0\.055to0\.0620\.062\. This small cost buys a robustness check that needs no labels: one iterates and traces the predicted spectrum from round to round\. A spectrum that barely moves, as at\+0\.2​E\+0\.2E, confirms that the single pass was already stable and iterations can be stopped\. The spectrum that moves substantially, as at−0\.2​E\-0\.2E, shows that the single pass was prior\-limited and that the iterates are the better estimate\. The natural stopping rule is therefore to iterate until the predicted spectrum shifts only slightly or stops changing at all between rounds\.

![Refer to caption](https://arxiv.org/html/2608.18190v1/images/iterada_panel_a.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.18190v1/images/iterada_panel_b.png)\(b\)

Figure 10:Iterative ADA under the triple mismatch\.\(a\)Target recoveryWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}against the iteration round, for a badly\-mismatched prior \(α=−0\.2\\alpha=\-0\.2, DA\-sourceBeta⁡\(3,2\)\\mathrm\{Beta\}\(3,2\)\) and a mild one \(α=\+0\.2\\alpha=\+0\.2, flat DA\-source\); round 1 is single\-pass ADA and the dotted lines are the corresponding no\-adaptation baselines\.\(b\)Predicted target spectra across rounds for the−0\.2​E\-0\.2Ecase, converging from the initial prior towards the trueBeta⁡\(2,5\)\\mathrm\{Beta\}\(2,5\)\.The results of this section demonstrate that even the triple domain mismatch case can be mitigated\. The key techniques for that are adaptive and iterative domain adaptations\.

## 5Model selection without target labels

Applying domain adaptation in practice requires somehow fixing the adversarial strengthλ\\lambda\. In a toy experiment one can pick the value that best recovers the known target labels, but in a real analysis they are unavailable by construction: the target energy spectrum is precisely the quantity to be measured, so the recoveryWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}is unavailable\. A usable procedure therefore needs a rule that selects the operating pointλ\\lambdafrom the training dynamics alone\.

The rule we arrive at has three steps\. The first step — whether to use domain adaptation at all — is decided by the source\-only reconstruction test of section[3\.3](https://arxiv.org/html/2608.18190#S3.SS3)\. If the autoencoder trained on the source domain successfully reconstructs target events, that is, if the reconstruction loss is small, domain adaptation is not needed, and vice versa\.

The next step is a*regression\-health gate*\. If the reconstruction loss function on the labelled training source — energy reconstruction on𝒟tr\\mathcal\{D\}\_\{\\mathrm\{tr\}\}in our case — exceeds a small multiple of the no\-DA baseline, the adversarial pressure has collapsed the regressor\. We set the thresholdMAEsrc\>3​MAEsrcbase\\mathrm\{MAE\}\_\{\\mathrm\{src\}\}\>3\\,\\mathrm\{MAE\}\_\{\\mathrm\{src\}\}^\{\\mathrm\{base\}\}and discard all model configuration that loses a large fraction \(\>30%\>30\\%\) of its seeds this way\. The factor of three inMAE\\mathrm\{MAE\}criterion is not a tuned quantity — it has only to be loose enough to pass a healthy run and tight enough to catch a collapse\.

Among the health\-gated survivors we need a label\-free signal that ranks the true recovery, and four candidates suggest themselves, each reading a different facet of the trained model\.*Marginal separability*LRacc\\mathrm\{LR\}\_\{\\mathrm\{acc\}\}is the accuracy of a fresh logistic\-regression domain classifier fit to the frozen event\-summary vectors — how far apart the two domains sit in latent space, ignoring the energy\. The*conditional discrepancy*is the conditional maximum mean discrepancyCMMD2\\mathrm\{CMMD\}^\{2\}of appendix[A](https://arxiv.org/html/2608.18190#A1), which measures the same latent mismatch, but separately in bins of the predicted energy and averaged over them\.*Augmentation consistency*is the stability of a run’s target predictions under label\-preserving perturbations of the input\. The*cross\-seed spread*is the mean pairwise Wasserstein distance between the predicted target spectra of independently seeded runs of one configuration\. The first two read the latent geometry; the last two read the stability of the predictions\.

To choose between them, we screen the four on the waveform\-and\-LDF case of section[4\.1](https://arxiv.org/html/2608.18190#S4.SS1)\. Each candidate is correlated \(Spearmanρ\\rho\) against the true target recoveryWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}, oriented so that a positive value means the signal ranks recovery correctly, table[1](https://arxiv.org/html/2608.18190#S5.T1)\. The purpose of this screen is not to establish the rule but to motivate it, by discarding the candidates that already fail on a case where domain adaptation works well\.

candidate label\-free signalkindρ\\rhomarginal separabilityLRacc\\mathrm\{LR\}\_\{\\mathrm\{acc\}\}marginal latent\+0\.3\+0\.3conditional discrepancy \(CMMD\)conditional latent\+0\.77\+0\.77augmentation consistencyprediction stability−0\.4\-0\.4to−0\.7\-0\.7cross\-seed spreadprediction stability\+1\.00\\mathbf\{\+1\.00\}Table 1:Label\-free selection signals ranked \(Spearmanρ\\rho\) against the true target recoveryWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}on the waveform\-and\-LDF case of section[4\.1](https://arxiv.org/html/2608.18190#S4.SS1), oriented so that a positive value means the signal ranks recovery correctly\. The no\-DA baseline is excluded from the ranking\.Three of the four candidates fail, and they fail for two distinct reasons\. The two latent signals do not pass due to the physics of the problem\. Marginal separability was already compromised in section[3\.2](https://arxiv.org/html/2608.18190#S3.SS2): a successful adaptation makes the domains*more*separable in latent space, not less, because the encoder has to read the local LDF shape in order to recover the energy slope\-tolerantly\.

The conditional discrepancy scores much better, but carries a structural flaw\. Its bins are defined by the model’s own predicted energy, so a residually pooled model sorts its compressed predictions into the wrong bins\. Comparing latents within such a bin then compares events of genuinely different energies, and the model reports a small discrepancy for the wrong reason\. The no\-DA baseline is the extreme case: it has a healthy source regression, the worst target recovery of all, and yet the lowestCMMD2\\mathrm\{CMMD\}^\{2\}of any configuration\. We have also verified that this criterion does not fit more complicated cases and hence was discarded\.

Augmentation consistency fails for the other reason, and its correlation is not merely weak but negative — it ranks the recovery backwards\. The cause is that it reads the stability of a*single*model, and a confidently biased model is perfectly stable\. A network that has collapsed onto a narrow, wrong spectrum will reproduce that spectrum under any label\-preserving perturbation of its input, and so scores as the most trustworthy of all\. Stability of one model is thus not evidence of anything; it is equally consistent with convergence and with confident failure\.

The cross\-seed spread avoids both traps because it reads neither the latent geometry nor any single model’s predictions, but the agreement between independently seeded runs of the same configuration\. A bias can be stable within one training, but two trainings that start from different weights agree on a spectrum only if the training has actually converged to it\. The adversarial instability that produces a poor mean recovery is the same instability that scatters the seeds, so the label\-free spread and the label\-requiring recovery move together\. We measure it as the mean pairwise Wasserstein distance between the per\-seed predicted target spectra, and pick the survivor with the smallest\.

In our experiments we traced how the cross\-seed spread depends on theλ\\lambdavalue\. In the limitλ→0\\lambda\\to 0it vanishes continuously since a critic too weak to move the encoder leaves every seed at the no\-DA baseline\. Thus, it is near zero on the under\-adapted branch\. Asλ\\lambdaincreases, the cross seed spread rises to a maximum where the alignment first engages and independent seeds scatter\. It then falls to a local minimum at the operating point, where the seeds re\-converge on the recovered spectrum\. At still largerλ\\lambdait grows again as the training destabilises\. The quantity to select is that*interior*minimum — the smallest spread among theλ\\lambdavalues lying above the engagement maximum\. This is our third step, constituting the core of the label\-free model\-selection criterion\. Applied in this form, the rule returns for every case studied above the configuration whoseWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}is within 25% of the best achievable result\.

In appendix[A](https://arxiv.org/html/2608.18190#A1)we briefly discuss other domain adaptation schemes that we tried but which bring no success\.

## 6Conclusion

Domain shift between the training and target domains is one of the main obstacles to applying neural networks for data analysis in physics and beyond\. Without domain adaptation the estimated target properties — the energy spectrum, in our case — can be strongly biased\. Using a toy air\-shower benchmark that exposes three distinct mismatches — a waveform nuisance, a lateral\-distribution physics shift, and an energy\-spectrum label shift — we showed that standard adversarial domain adaptation is not a safe default\. It handles a conditional shift on its own, but once a label shift is present and the simulated spectrum is imperfect, it pulls the predicted spectrum toward that simulation prior, biasing the very quantity to be measured\. A targeted method is needed to keep this bias bounded\.

To resolve this problem, we introduce Adaptive Domain Adaptation \(ADA\), aimed at the label shift\. After each training epoch it reweights the DA\-source events so that their predicted spectrum matches the target’s\. This removes the energy spectrum from the domain\-discriminative features and lets the adversary act only on the genuine physical shift\. ADA extends importance\-weighted adversarial alignment from classification to label\-free regression, and recovers a faithful target spectrum in the joint spectrum\-and\-physics regime where standard domain adaptation fails\.

When the target spectrum is unknown, the assumed spectrum can itself be refined: the predicted target spectrum of one training round becomes the DA\-source prior of the next, and the estimate converges to a self\-consistent spectrum that approximates the truth\. This iterative domain adaptation corrects the assumed prior not only from epoch to epoch within a training but from round to round across trainings, and applies to any of the adaptation schemes above whenever the initial spectrum is only an approximation\.

The predicted spectrum depends on the strength of domain adaptation, controlled by theλ\\lambdaparameter\. To select its proper value we developed a label\-free model\-selection rule based on cross\-seed spread of neural network predictions\. For properly converged domain adaptation this spread is minimal, indicating that the neural network learns the same features independently of the initial random state\. We verified that the rule returns a configuration within25%25\\%of the label\-chosen optimum across every case studied, so that the methods above can be deployed where, by construction, no reliable target labels exist\.

An interesting finding is that successful adaptation does not make the two domains indistinguishable in latent space\. Under the LDF mismatch a logistic regression fitted to the frozen event summaries separates them*better*after adaptation than before\. The encoder has to read the local shape of the LDF in order to recover the energy slope\-tolerantly, so the latents necessarily carry the slope, and with it the domain\. What adaptation makes invariant is the prediction, not the representation, and diagnostics built on latent domain\-invariance are therefore reading the wrong quantity\.

Table[2](https://arxiv.org/html/2608.18190#S6.T2)summarises which adaptation scheme to use depending on the domain mismatch type\. When the source\-only reconstruction test of section[3\.3](https://arxiv.org/html/2608.18190#S3.SS3)finds no shift, the network already interpolates correctly and no adaptation should be applied\. When a shift is present and the assumed spectrum is trustworthy, standard DANN is the method of choice: sections[4\.2](https://arxiv.org/html/2608.18190#S4.SS2)and[4\.4](https://arxiv.org/html/2608.18190#S4.SS4)show it to be slightly better in that narrow band\. When the assumed spectrum is only an approximation, the choice turns on whether the domain shift can be localized\. If it can — as with the waveform mismatch of section[4\.3](https://arxiv.org/html/2608.18190#S4.SS3)— staged DA, with its source spectrum refined by iteration, is the most accurate, and a localized ADA critic is a simpler alternative not far behind\. If it cannot, the event\-wise ADA critic is the safer choice, since sub\-critics see only a part of the mismatch and are biased by the part they cannot resolve\. In either case iterative domain adaptation — feeding the network’s own prediction back as the prior — refines the assumed spectrum and brings the estimate closer to the truth\.

knowledge of the target spectrumdomain shiftrecommended scheme—none detectedno adaptation; the network already interpolatestrustworthyanyDANN with an event\-wise criticapproximatelocalizedstaged DA or ADA with localized criticapproximatenot localizedADA with an event\-wise criticTable 2:Practical guidance on the choice of the adaptation scheme\.The discussed mismatch regimes are often encountered in physics\. They arise whenever a network is trained on simulations known to be imperfect and applied to data whose distribution is itself the quantity being measured\. Such a situation is rather common in astroparticle physics\. Cosmic\-ray and neutrino observatories reconstruct events with neural networks\[[23](https://arxiv.org/html/2608.18190#bib.bib24),[17](https://arxiv.org/html/2608.18190#bib.bib22),[21](https://arxiv.org/html/2608.18190#bib.bib23),[24](https://arxiv.org/html/2608.18190#bib.bib29)\], and estimating the energy spectrum is among their primary physics goals\[[25](https://arxiv.org/html/2608.18190#bib.bib19),[5](https://arxiv.org/html/2608.18190#bib.bib21)\]\. The muon puzzle, however, remains a simulation\-to\-data discrepancy that needs to be mitigated to obtain a reliable spectrum estimate\. Moreover, the complexity of the detector system, simplifications in MC simulations, and approximations of the particle cross\-section at high energies inevitably lead to domain shift\. Hence domain adaptation is a prerequisite for reliable data analyses\.

Cosmology offers another promising application of these methods\. In this field neural networks are trained on simulations, labels for the observed data are unavailable, and the distribution of the inferred quantity is itself the measurement\. In photometric redshift estimation this distribution is calibrated on a spectroscopic sample that is not representative of the survey\. In simulation\-based inference\[[37](https://arxiv.org/html/2608.18190#bib.bib12),[34](https://arxiv.org/html/2608.18190#bib.bib37)\]it is fixed by the cosmology assumed when generating the training data\. In both cases a standard adversary would pull the result towards that prior, just as it pulls the reconstructed spectrum towards the simulated one above\. With surveys such as Rubin and Euclid now delivering unlabelled data on a large scale\[[22](https://arxiv.org/html/2608.18190#bib.bib42),[8](https://arxiv.org/html/2608.18190#bib.bib43)\], these methods might find a useful application\.

## Acknowledgments

This work was supported by the Russian Science Foundation under grant no\. 24\-72\-10056\.

## Appendix AMethods that did not work

In order to improve domain adaptation, we tried two other methods, based on self\-supervised learning \(SSL\) and maximum mean discrepancy \(MMD\)\. None of them, however, helped, and below we briefly report on them\.

Following the logic of foundation models\[[12](https://arxiv.org/html/2608.18190#bib.bib6)\], we tried implementing SSL\. The network carries an auxiliary decoder and is trained to reconstruct the full event — the per\-station waveforms and scalars — from the event summary, on both source and target events\. The intent is to stop the encoder from folding target events onto the source manifold: a representation that must reconstruct genuine target events cannot discard everything that makes them different, which should limit the pooling toward the DA\-source physics\.

In practice SSL hurt the adaptation, raisingWDtgt\\mathrm\{WD\}\_\{\\mathrm\{tgt\}\}by1010–30%30\\%across the cases we tried\. The reconstruction objective teaches the network what a target event looks like, but supplies no energy label, so it does not help the regression\. Added on top of the already adversarial domain\-adaptation loss, it only makes the shared encoder’s optimization harder and degrades the recovered spectrum\. This is the same lesson as the staged encoder of section[4\.3](https://arxiv.org/html/2608.18190#S4.SS3): a representation learned without labels is robust against the mismatch it was trained to ignore, but does not help to restore true labels\.

The second method is the maximum mean discrepancy \(MMD\)\[[19](https://arxiv.org/html/2608.18190#bib.bib3)\], in its conditional form\. Given two batches of latent vectors\{zisrc\}i=1Ns\\\{z^\{\\mathrm\{src\}\}\_\{i\}\\\}\_\{i=1\}^\{N\_\{s\}\}and\{zjtgt\}j=1Nt\\\{z^\{\\mathrm\{tgt\}\}\_\{j\}\\\}\_\{j=1\}^\{N\_\{t\}\}and a kernelk⁡\(z,z′\)k\(z,z^\{\\prime\}\), the empirical squared MMD is

MMD2=1Ns2​∑i,jk⁡\(zisrc,zjsrc\)\+1Nt2​∑i,jk⁡\(zitgt,zjtgt\)−2Ns​Nt​∑i,jk⁡\(zisrc,zjtgt\)\.\\mathrm\{MMD\}^\{2\}\\;=\\;\\frac\{1\}\{N\_\{s\}^\{2\}\}\\sum\_\{i,j\}k\(z^\{\\mathrm\{src\}\}\_\{i\},z^\{\\mathrm\{src\}\}\_\{j\}\)\+\\frac\{1\}\{N\_\{t\}^\{2\}\}\\sum\_\{i,j\}k\(z^\{\\mathrm\{tgt\}\}\_\{i\},z^\{\\mathrm\{tgt\}\}\_\{j\}\)\-\\frac\{2\}\{N\_\{s\}N\_\{t\}\}\\sum\_\{i,j\}k\(z^\{\\mathrm\{src\}\}\_\{i\},z^\{\\mathrm\{tgt\}\}\_\{j\}\)\\;\.\(A\.1\)It vanishes in the large\-sample limit if and only if the two batches are drawn from the same underlying latent distribution\. We use a Gaussian kernelk⁡\(z,z′\)=exp⁡\(−γ​‖z−z′‖2\)k\(z,z^\{\\prime\}\)=\\exp\(\-\\gamma\\\|z\-z^\{\\prime\}\\\|^\{2\}\)summed over a short multi\-bandwidth setγ∈\{0\.1,1,10\}\\gamma\\in\\\{0\.1,1,10\\\}, so the result is insensitive to per\-feature scaling and detects differences of any order beyond a linear classifier’s reach\.

For a regression one wants latents to agree at*fixed label*, since that is what determines whether a source\-trained regressor gives the right answer on a target event\. Target labels are unavailable, but the network’s predicted energyE^\\hat\{E\}is a deployable proxy\. Binning source and target events byE^\\hat\{E\}intoBBuniform bins on\[0,1\]\[0,1\], computingMMDb2\\mathrm\{MMD\}^\{2\}\_\{b\}inside each bin and averaging over bins gives the*conditional*maximum mean discrepancy:

CMMD2=1B​∑bMMDb2\.\\mathrm\{CMMD\}^\{2\}\\;=\\;\\frac\{1\}\{B\}\\sum\_\{b\}\\mathrm\{MMD\}^\{2\}\_\{b\}\\;\.\(A\.2\)We useB=10B=10to test this approach and verified that the results are qualitatively the same forBBbetween55and2020\. The CMMD loss is added to the total loss function with a tunable coefficient\.

This construction, however, has the same weakness that disqualifiedCMMD2\\mathrm\{CMMD\}^\{2\}as a selection signal in section[5](https://arxiv.org/html/2608.18190#S5): the bins are set by the model’s own predicted energy\. A confidently biased model sorts its shifted target predictions into the wrong bins and then forces the latents of genuinely different\-energy source and target events into alignment\. The result is a self\-reinforcing loop — the alignment deepens the bias, which mis\-bins the events further — because the criterion has no internal handle on the true target energy\. Combining CMMD with ADA did not remove this failure: CMMD keeps over\-aligning the wrong latent subspaces, and at no setting of its coefficient did the combination improve on ADA alone\.

## References

- \[1\]A\. Aabet al\.\(2014\)Muons in air showers at the pierre auger observatory: measurement of atmospheric production depth\.Phys\. Rev\. D90\(1\),pp\. 012012\.External Links:1407\.5919,[Document](https://dx.doi.org/10.1103/PhysRevD.90.012012)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[2\]A\. Aabet al\.\(2016\)Testing hadronic interactions at ultrahigh energies with air showers measured by the pierre auger observatory\.Phys\. Rev\. Lett\.117\(19\),pp\. 192001\.External Links:1610\.08509,[Document](https://dx.doi.org/10.1103/PhysRevLett.117.192001)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[3\]R\. Abbasi, M\. Ackermann, J\. Adams, J\. Aguilar, M\. Ahlers, M\. Ahrens, J\. Alameddine, A\. Alves Jr, N\. Amin, K\. Andeen,et al\.\(2022\)Density of gev muons in air showers measured with icetop\.Physical Review D106\(3\),pp\. 032010\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[4\]R\. U\. Abbasiet al\.\(2018\)Study of muons from ultrahigh energy cosmic ray air showers measured with the Telescope Array experiment\.Phys\. Rev\. D98\(2\),pp\. 022002\.External Links:1804\.03877,[Document](https://dx.doi.org/10.1103/PhysRevD.98.022002)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[5\]P\. Abreuet al\.\(2022\)Testing effects of Lorentz invariance violation in the propagation of astroparticles with the Pierre Auger Observatory\.JCAP01\(01\),pp\. 023\.External Links:[Document](https://dx.doi.org/10.1088/1475-7516/2022/01/023),2112\.06773Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p7.1)\.
- \[6\]H\. Ajakan, P\. Germain, H\. Larochelle, F\. Laviolette, and M\. Marchand\(2014\)Domain\-adversarial neural networks\.arXiv preprint arXiv:1412\.4446\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[7\]J\. C\. Arteaga\-Velázquez\(2023\)A report by the whisp working group on the combined analysis of muon data at cosmic\-ray energies above 1 pev\.PoSICRC2023,pp\. 466\.External Links:[Document](https://dx.doi.org/10.22323/1.444.0466)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[8\]H\. Ausselet al\.\(2026\)Euclid Quick Data Release \(Q1\) \- I\. Data release overview\.Astron\. Astrophys\.711,pp\. A1\.External Links:2503\.15302,[Document](https://dx.doi.org/10.1051/0004-6361/202554610)Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p8.1)\.
- \[9\]M\. Baalouchet al\.\(2019\)Sim\-to\-real domain adaptation for high energy physics\.External Links:1912\.08001Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[10\]K\. Bousmalis, A\. Irpan, P\. Wohlhart, Y\. Bai, M\. Kelcey, M\. Kalakrishnan, L\. Downs, J\. Ibarz, P\. Pastor, K\. Konolige,et al\.\(2018\)Using simulation and domain adaptation to improve efficiency of deep robotic grasping\.In2018 IEEE international conference on robotics and automation \(ICRA\),pp\. 4243–4250\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[11\]M\. Dell’aieraet al\.\(2023\)Deep unsupervised domain adaptation applied to the cherenkov telescope array large\-sized telescope\.CBMI ’23: Proceedings of the 20th International Conference on Content\-based Multimedia Indexing,pp\. 133–139\.External Links:2308\.12732,[Document](https://dx.doi.org/10.1145/3617233.3617279)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[12\]J\. Devlin, M\. Chang, K\. Lee, and K\. Toutanova\(2019\)BERT: pre\-training of deep bidirectional transformers for language understanding\.InProceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics \(NAACL\),pp\. 4171–4186\.Cited by:[Appendix A](https://arxiv.org/html/2608.18190#A1.p2.1),[§2\.2](https://arxiv.org/html/2608.18190#S2.SS2.p4.1),[§3\.3](https://arxiv.org/html/2608.18190#S3.SS3.p5.1),[§4\.3](https://arxiv.org/html/2608.18190#S4.SS3.p3.1)\.
- \[13\]V\. Estradeet al\.\(2019\)Systematic aware learning: a case study in high energy physics\.EPJ Web Conf\.214,pp\. 06024\.External Links:[Document](https://dx.doi.org/10.1051/epjconf/201921406024)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[14\]A\. Farahani, S\. Voghoei, K\. Rasheed, and H\. R\. Arabnia\(2021\)A brief review of domain adaptation\.Advances in data science and information engineering: proceedings from ICDATA 2020 and IKE 2020,pp\. 877–894\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1),[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[15\]Y\. Ganin, E\. Ustinova, H\. Ajakan, P\. Germain, H\. Larochelle, F\. Laviolette, M\. Marchand, and V\. Lempitsky\(2016\)Domain\-adversarial training of neural networks\.Journal of Machine Learning Research17\(59\),pp\. 1–35\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1),[§1](https://arxiv.org/html/2608.18190#S1.p5.1),[§1](https://arxiv.org/html/2608.18190#S1.p7.1),[§2\.2](https://arxiv.org/html/2608.18190#S2.SS2.p5.1),[§2\.2](https://arxiv.org/html/2608.18190#S2.SS2.p9.1)\.
- \[16\]A\. Ghosh, B\. Nachman, and D\. Whiteson\(2021\)Uncertainty\-aware machine learning for high energy physics\.Phys\. Rev\. D104\(5\),pp\. 056026\.External Links:[Document](https://dx.doi.org/10.1103/PhysRevD.104.056026),2105\.08742Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[17\]J\. Glombitza\(2020\)Air\-Shower Reconstruction at the Pierre Auger Observatory based on Deep Learning\.PoSICRC2019,pp\. 270\.External Links:[Document](https://dx.doi.org/10.22323/1.358.0270)Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p7.1)\.
- \[18\]X\. Glorot, A\. Bordes, and Y\. Bengio\(2011\)Domain adaptation for large\-scale sentiment classification: a deep learning approach\.InProceedings of the 28th international conference on machine learning \(ICML\-11\),pp\. 513–520\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[19\]A\. Gretton, K\. M\. Borgwardt, M\. J\. Rasch, B\. Schölkopf, and A\. Smola\(2012\)A kernel two\-sample test\.Journal of Machine Learning Research13,pp\. 723–773\.Cited by:[Appendix A](https://arxiv.org/html/2608.18190#A1.p4.1)\.
- \[20\]A\. Hayrapetyanet al\.\(2025\)Dark sector searches with the CMS experiment\.Phys\. Rept\.1115,pp\. 448–569\.External Links:[Document](https://dx.doi.org/10.1016/j.physrep.2024.09.013),2405\.13778Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[21\]M\. Huennefeld\(2018\)Deep Learning in Physics exemplified by the Reconstruction of Muon\-Neutrino Events in IceCube\.PoSICRC2017,pp\. 1057\.External Links:[Document](https://dx.doi.org/10.22323/1.301.1057)Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p7.1)\.
- \[22\]Ž\. Ivezićet al\.\(2019\)LSST: from Science Drivers to Reference Design and Anticipated Data Products\.Astrophys\. J\.873\(2\),pp\. 111\.External Links:0805\.2366,[Document](https://dx.doi.org/10.3847/1538-4357/ab042c)Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p8.1)\.
- \[23\]O\. Kalashev, I\. Kharuk, M\. Kuznetsov, G\. Rubtsov, T\. Sako, Y\. Tsunesada, and Ya\. Zhezher\(2022\)Deep learning method for identifying mass composition of ultra\-high\-energy cosmic rays\.JINST17\(05\),pp\. P05008\.External Links:[Document](https://dx.doi.org/10.1088/1748-0221/17/05/P05008),2112\.02072Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p7.1)\.
- \[24\]I\. Kharuk, G\. Plotnikov, and A\. Matseiko\(2025\)Machine\-Learning Applications in Baikal\-GVD: Current Status\.Physics of Atomic Nuclei88\.External Links:[Document](https://dx.doi.org/10.1134/S1063778825700449)Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p7.1)\.
- \[25\]J\. Kim, D\. Ivanov, C\. Jui, and G\. Thomson\(2023\)Energy spectrum measured by the telescope array surface detectors\.InEPJ Web of Conferences,Vol\.283,pp\. 02005\.Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p7.1)\.
- \[26\]W\. M\. Kouw and M\. Loog\(2018\)An introduction to domain adaptation and transfer learning\.arXiv preprint arXiv:1812\.11806\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1),[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[27\]K\. Kushibar, M\. Salem, S\. Valverde, À\. Rovira, J\. Salvi, A\. Oliver, and X\. Lladó\(2021\)Transductive transfer learning for domain adaptation in brain magnetic resonance image segmentation\.Frontiers in Neuroscience15,pp\. 608808\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[28\]Z\. C\. Lipton, Y\. Wang, and A\. Smola\(2018\)Detecting and correcting for label shift with black box predictors\.InProceedings of the 35th International Conference on Machine Learning \(ICML\),pp\. 3122–3130\.Cited by:[§4\.2](https://arxiv.org/html/2608.18190#S4.SS2.p7.1)\.
- \[29\]J\. Liu, Z\. Shen, Y\. He, X\. Zhang, R\. Xu, H\. Yu, and P\. Cui\(2021\)Towards out\-of\-distribution generalization: a survey\.arXiv preprint arXiv:2108\.13624\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[30\]M\. Long, Y\. Cao, J\. Wang, and M\. Jordan\(2015\)Learning transferable features with deep adaptation networks\.InInternational conference on machine learning,pp\. 97–105\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[31\]S\. May\(2022\)Machine learning in cms\.Int\. J\. Mod\. Phys\. A37\(33\),pp\. 2240020\.External Links:[Document](https://dx.doi.org/10.1142/S0217751X22400206)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[32\]A\. Moss\(2018\)Improved Photometric Classification of Supernovae using Deep Learning\.External Links:1810\.06441Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[33\]R\. Novak, Y\. Bahri, D\. A\. Abolafia, J\. Pennington, and J\. Sohl\-Dickstein\(2018\)Sensitivity and generalization in neural networks: an empirical study\.arXiv preprint arXiv:1802\.08760\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p2.1)\.
- \[34\]S\. Pandya, P\. Patel, B\. D\. Nord, M\. Walmsley, and A\. Ćiprijanović\(2025\)SIDDA: SInkhorn Dynamic Domain Adaptation for Image Classification with Equivariant Neural Networks\.External Links:2501\.14048Cited by:[§6](https://arxiv.org/html/2608.18190#S6.p8.1)\.
- \[35\]M\. Saerens, P\. Latinne, and C\. Decaestecker\(2002\)Adjusting the outputs of a classifier to new a priori probabilities: a simple procedure\.Neural Computation14\(1\),pp\. 21–41\.Cited by:[§4\.2](https://arxiv.org/html/2608.18190#S4.SS2.p7.1)\.
- \[36\]A\. Steinet al\.\(2022\)Improving robustness of jet tagging algorithms with adversarial training\.Comput\. Softw\. Big Sci\.6\(1\),pp\. 15\.External Links:2203\.13890,[Document](https://dx.doi.org/10.1007/s41781-022-00087-1)Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1)\.
- \[37\]P\. Swiercet al\.\(2024\)Domain\-adaptive neural posterior estimation for strong gravitational lens analysis\.External Links:2410\.16347Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p4.1),[§6](https://arxiv.org/html/2608.18190#S6.p8.1)\.
- \[38\]R\. Tachet des Combes, H\. Zhao, Y\. Wang, and G\. J\. Gordon\(2020\)Domain adaptation with conditional distribution matching and generalized label shift\.InAdvances in Neural Information Processing Systems 33 \(NeurIPS 2020\),pp\. 19276–19289\.External Links:2003\.04475Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p5.1),[§1](https://arxiv.org/html/2608.18190#S1.p8.1),[§2\.1](https://arxiv.org/html/2608.18190#S2.SS1.p8.1),[§4\.2](https://arxiv.org/html/2608.18190#S4.SS2.p5.1),[§4\.2](https://arxiv.org/html/2608.18190#S4.SS2.p7.1)\.
- \[39\]A\. Vaswaniet al\.\(2017\)Attention Is All You Need\.External Links:1706\.03762Cited by:[§2\.2](https://arxiv.org/html/2608.18190#S2.SS2.p4.1)\.
- \[40\]R\. Wang, P\. Chaudhari, and C\. Davatzikos\(2022\)Embracing the disharmony in medical imaging: a simple and effective framework for domain adaptation\.Medical image analysis76,pp\. 102309\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[41\]K\. Xu, M\. Zhang, J\. Li, S\. S\. Du, K\. Kawarabayashi, and S\. Jegelka\(2021\)How neural networks extrapolate: from feedforward to graph neural networks\.International Conference on Learning Representations \(ICLR\)\.Note:VERIFY: cite key says 2022; entry is the ICLR 2021 paperCited by:[§1](https://arxiv.org/html/2608.18190#S1.p3.1)\.
- \[42\]J\. Zhang, Z\. Ding, W\. Li, and P\. Ogunbona\(2018\)Importance weighted adversarial nets for partial domain adaptation\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 8156–8164\.External Links:1803\.09210Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p8.1),[§4\.2](https://arxiv.org/html/2608.18190#S4.SS2.p7.1)\.
- \[43\]T\. Zhang, C\. Zhao, G\. Chen, Y\. Jiang, and F\. Chen\(2024\)Feature contamination: neural networks learn uncorrelated features and fail to generalize\.arXiv preprint arXiv:2406\.03345\.Cited by:[§1](https://arxiv.org/html/2608.18190#S1.p2.1)\.

Similar Articles

Domain-Adaptive Climate Downscaling Under Temporal Distribution Shift

arXiv cs.LG

This paper investigates temporal out-of-distribution shift in deep-learning-based climate downscaling and proposes a domain-adaptive framework that combines supervised reconstruction with domain alignment to improve high-resolution climate projections under non-stationary conditions.

Semi-Supervised Noise Adaptation: Transferring Knowledge from Noise Domain

Hugging Face Daily Papers

This paper introduces Semi-Supervised Noise Adaptation (SSNA), a novel framework that uses synthetic noise domains (e.g., Gaussian distributions) as surrogate source domains to improve generalization in semi-supervised learning settings. The proposed Noise Adaptation Framework (NAF) establishes a generalization bound and demonstrates improved target domain performance.