Mix, Don't Pick: Why Synthetic Corpus Composition Matters for Time Series Foundation Model Pretraining
Summary
This paper systematically evaluates 11 synthetic time-series generators for foundation model pretraining and finds that generator rankings are not stable across architectures, but an equal-weight mixture of all generators matches or beats the best individual. Blending this mixture with real data yields the strongest pretraining corpora, reframing synthetic pretraining as a corpus composition problem rather than a generator selection problem.
View Cached Full Text
Cached at: 06/10/26, 06:17 AM
# Mix, Don’t Pick: Why Synthetic Corpus Composition Matters for Time Series Foundation Model Pretraining
Source: [https://arxiv.org/html/2606.09912](https://arxiv.org/html/2606.09912)
###### Abstract
Choosing the wrong synthetic generator for time\-series foundation model pretraining is costly: under identical training budgets, the best and worst generators produce up to a2×2\\timesgap in forecasting error, yet the field has no principled way to make this choice\. The problem is compounded by the fact that generator rankings are not stable across architectures: across 11 generator families evaluated on Chronos\-T5\-Mini and Moirai\-Small trained from scratch, we find that which generators are useful depends on the model architecture\. Rather than solving the generator selection problem, we sidestep it: a simple equal\-weight mixture of all generators matches or beats the best individual generator for both architectures, and composing this mixture with real data yields the strongest pretraining corpora overall\. Synthetic pretraining is therefore a corpus composition problem, not a generator selection problem, and composition choices should be validated per model family rather than assumed to transfer\.
## 1Introduction
Time\-series foundation models \(TSFMs\) are increasingly pretrained on synthetic data, either as the primary source\(Moroshanet al\.,[2025](https://arxiv.org/html/2606.09912#bib.bib6)\)or as augmentation alongside real corpora\(Ansariet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib1)\), motivated by the scarcity and licensing constraints of real\-world data\. Yet the choice of which generators to use and how to combine them is typically made ad hoc\. Generator selection is driven by convention or convenience rather than systematic evaluation, and the broader question of how to compose a pretraining corpus, including which generators to include, whether to mix families, and how much real data to blend in, remains largely unexamined\.
A natural approach is to select generators whose output most closely resembles real time series, an assumption implicit in feature\-based validation work that measures whether synthetic series match real statistical structure\(Bahrpeymaet al\.,[2021](https://arxiv.org/html/2606.09912#bib.bib11); Fulcher and Jones,[2017](https://arxiv.org/html/2606.09912#bib.bib23); Lubbaet al\.,[2019](https://arxiv.org/html/2606.09912#bib.bib18)\)\. However, resemblance to real data and usefulness for pretraining are distinct properties\.
Existing work on synthetic TSFM pretraining\(Ansariet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib1); Daset al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib32); Moroshanet al\.,[2025](https://arxiv.org/html/2606.09912#bib.bib6); Wooet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib27)\)has not systematically tested whether fidelity\-based generator selection translates to downstream performance, whether generator rankings transfer across model architectures, or how synthetic and real data should be balanced in a pretraining corpus\.
We argue that these are not isolated questions but facets of a single corpus composition problem, analogous to the data mixing challenges studied in large language model pretraining, where corpus design decisions have been shown to substantially affect downstream quality\(Xieet al\.,[2023](https://arxiv.org/html/2606.09912#bib.bib33)\)\.
To test this, we conduct a systematic evaluation of 11 synthetic generator families spanning statistical, stochastic, dynamical, and waveform\-based processes\. We train Chronos\-T5\-Mini\(Ansariet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib1)\)and Moirai\-Small\(Wooet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib27)\)from scratch on each generator individually and on an equal\-weight mixture of all 11 generators\. We then study real–synthetic composition by blending a real reference corpus with the synthetic mixture at varying ratios\. The real reference is sampled from the GIFT\-Eval pretraining pool\(Aksuet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib22)\), with train–test leakage avoided by construction\. All models are evaluated zero\-shot on the 28\-dataset GIFT\-Eval benchmark\.
Our study yields three main findings:
1. 1\.Synthetic generators are not interchangeable: across 11 generator families, downstream utility varies widely under identical training budgets, and generator rankings differ substantially between Chronos\-T5\-Mini and Moirai\-Small\.
2. 2\.An equal\-weight mixture of all generators provides a robust synthetic\-only default: it matches the strongest individual generator for Moirai\-Small and improves over it for Chronos\-T5\-Mini\.
3. 3\.Composing real and synthetic data can match or improve over pure\-source baselines for both architectures, with the strongest corpora combining the two\. The optimal ratio is architecture\-dependent, motivating per\-model validation of corpus composition\.
## 2Experimental Design
We evaluate synthetic time\-series pretraining as a corpus composition problem\. Our design trains two TSFM architectures from scratch on each of 11 synthetic generators individually, on multi\-generator and real–synthetic mixtures, and on a real reference corpus, then evaluates all models zero\-shot on a shared benchmark\.
### 2\.1Synthetic and Real Corpora
We construct synthetic corpora from 11 time\-series generators \(see Appendix[C](https://arxiv.org/html/2606.09912#A3)\), producing 11\.2B time points in total\. Each generator\-specific corpus contains 1M univariate windows of length 1024\. The generator pool spans linear statistical models such as ARIMA and ETS\(Box and Jenkins,[1970](https://arxiv.org/html/2606.09912#bib.bib12); Hyndmanet al\.,[2008](https://arxiv.org/html/2606.09912#bib.bib15)\), stochastic process families including fBm, SDEs, and GARCH\-type volatility models\(Mandelbrot and Van Ness,[1968](https://arxiv.org/html/2606.09912#bib.bib14); Uhlenbeck and Ornstein,[1930](https://arxiv.org/html/2606.09912#bib.bib7); Gillespie,[1996](https://arxiv.org/html/2606.09912#bib.bib9); Bollerslev,[1986](https://arxiv.org/html/2606.09912#bib.bib3)\), deterministic chaotic systems\(Lorenz,[1963](https://arxiv.org/html/2606.09912#bib.bib16); Mackey and Glass,[1977](https://arxiv.org/html/2606.09912#bib.bib17)\), composite signal generation through TimeSynth\(Maatet al\.,[2017](https://arxiv.org/html/2606.09912#bib.bib10)\), trend\-seasonality\-irregularity decomposition\(Bahrpeymaet al\.,[2021](https://arxiv.org/html/2606.09912#bib.bib11)\), structural and non\-smooth periodic generators inspired by StepFunction and Waveform families\(Moroshanet al\.,[2025](https://arxiv.org/html/2606.09912#bib.bib6)\), and Gaussian\-process based KernelSynth generators\(Ansariet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib1); Rasmussen and Williams,[2006](https://arxiv.org/html/2606.09912#bib.bib2)\)\. Full generator descriptions and hyperparameter distributions are provided in Appendix[A](https://arxiv.org/html/2606.09912#A1)\.
For real data, we construct a reference corpus from the GIFT\-Eval pretraining dataset\(Aksuet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib22)\), which is aligned with the downstream GIFT\-Eval benchmark while avoiding train–test leakage\. Because available long\-context real series are unevenly distributed across domains, this reference corpus is availability\-constrained rather than uniformly balanced\. We sample 1M univariate windows of length 1024, stratifying by frequency and domain where possible\. To reduce dominance by large sources, we impose minimum allocations for viable strata and per\-dataset caps\. We exclude series shorter than 1024\. Full sampling details are provided in Appendix[D](https://arxiv.org/html/2606.09912#A4)\.
We train on all 11 single\-generator corpora, an equal\-weight mixture of all 11 generators \(Mixed11\), the real reference corpus, and real–synthetic mixtures combining the real reference with Mixed11 at 75\-25, 50\-50, and 25\-75 real\-synthetic ratios by window count\. All training corpora are matched at 1M windows of length 1024\. Appendix[C](https://arxiv.org/html/2606.09912#A3)provides the full corpus manifest\.
### 2\.2Models and Evaluation
We train Chronos\-T5\-Mini\(Ansariet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib1)\)and Moirai\-Small\(Wooet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib27)\)from scratch on each corpus under matched training budgets\. Full training configuration is in Appendix[E](https://arxiv.org/html/2606.09912#A5)\.
We evaluate all models zero\-shot on the 28\-dataset GIFT\-Eval benchmark\. Because many datasets are evaluated at multiple forecast horizons, paired bootstrap comparisons use dataset–horizon tasks as the resampling unit, yielding 97 task\-level observations\. We report normalised CRPS\(Gneiting and Raftery,[2007](https://arxiv.org/html/2606.09912#bib.bib29)\), a probabilistic forecasting error, and normalised MASE\(Hyndman and Koehler,[2006](https://arxiv.org/html/2606.09912#bib.bib30)\), a scale\-free point\-forecasting error\. Both are normalised against the seasonal\-naive baseline, so lower is better and values below 1 indicate improvement over that baseline\.
## 3Results
We organise the results around three questions\. First, how much does the choice of synthetic generator matter under a fixed training budget? Second, can a simple multi\-generator mixture provide a robust alternative to selecting a single generator? Third, when real data is available, does adding synthetic data help, or does it merely dilute the real corpus? Across both architectures, the answer is that corpus composition has a first\-order effect on zero\-shot forecasting performance\.
### 3\.1Single\-Generator Corpora
A natural first strategy is to identify a strong synthetic generator and pretrain on it\. To evaluate this strategy, we train each architecture on each synthetic generator separately under the same corpus size and training budget\. Table[1](https://arxiv.org/html/2606.09912#S3.T1)reports the resulting zero\-shot performance, alongside the real reference corpus as an anchor\.
Table 1:Zero\-shot GIFT\-Eval performance\. Scores are geometric means across 97 evaluation tasks\. Lower is better; values below 1\.000 beat seasonal naïve\.Boldmarks the best single\-generator corpus for each model and metric\.Underline: second\-best per model \(ETS for Moirai\-Small; SDE for Chronos\-T5\-Mini\)\. Sorted by Moirai\-Small CRPS\.Moirai\-SmallChronos\-T5\-MiniGeneratorCRPSMASECRPSMASEKernelSynth0\.7341\.0490\.9361\.290ETS0\.8201\.1541\.9762\.694Waveform0\.8701\.2401\.3281\.841SDE0\.9101\.3060\.9811\.282StepFunction0\.9581\.3911\.0481\.359TSI0\.9691\.3691\.1951\.679ARIMA0\.9881\.4301\.1281\.916fBm1\.0361\.4191\.6812\.495GARCH1\.0551\.4661\.1081\.863Chaotic1\.1541\.6361\.8422\.867TimeSynth1\.1941\.6591\.1531\.884Real Reference0\.8141\.1490\.7911\.061Under identical training budgets, generator choice has a substantial effect: CRPS varies by a factor of 1\.6 across generators for Moirai\-Small and 2\.1 for Chronos\-T5\-Mini\. The ranking also does not transfer cleanly across architectures or metrics\. KernelSynth is the strongest generator by CRPS for both architectures, but SDE gives the best synthetic MASE for Chronos\-T5\-Mini\. More strikingly, ETS is the second\-best generator for Moirai\-Small by CRPS, yet it is the weakest generator for Chronos\-T5\-Mini\. These results suggest that single\-generator selection is a model\-dependent decision rather than a universally transferable recipe\.
### 3\.2Multi\-Generator Mixing
The single\-generator sweep shows that generator rankings can depend on the target architecture\. This raises a practical question: instead of selecting one generator, can we obtain a more robust synthetic pretraining corpus by mixing diverse generators? We test this with Mixed11, an equal\-weight mixture over all 11 generator families\. Table[2](https://arxiv.org/html/2606.09912#S3.T2)compares Mixed11 with the strongest single\-generator baselines identified in the previous section\.
Table 2:Mixed11 compared with the strongest single\-generator baselines for each architecture\. Scores are geometric means across 97 evaluation tasks\. Lower is better\.ModelConditionCRPSMASEMoirai\-SmallKernelSynth0\.7341\.049ETS0\.8201\.154Mixed110\.7351\.069Chronos\-T5\-MiniKernelSynth0\.9361\.290SDE0\.9811\.282Mixed110\.9061\.171For Moirai\-Small, Mixed11 is essentially tied with KernelSynth on CRPS and remains clearly ahead of the next\-best generator, ETS\. For Chronos\-T5\-Mini, the benefit is stronger: Mixed11 improves over both KernelSynth and SDE on CRPS, and also gives the best MASE among the displayed synthetic corpora\. Thus, mixing does not simply average away useful structure from strong generators\. Instead, it provides a robust synthetic\-only corpus that is competitive with, and in some cases better than, the best individual generator observed in the sweep\.
To verify that this comparison is not driven only by small aggregate differences, we isolate the paired bootstrap comparison between KernelSynth and Mixed11\. This is the most direct comparison for the synthetic\-only setting because KernelSynth is the strongest single\-generator baseline by CRPS in the seed\-42 sweep, while Mixed11 tests whether combining generators can preserve or improve over the best individual source\. Full single\-generator and composition bootstrap results are reported in Appendix[G](https://arxiv.org/html/2606.09912#A7)\.
Table 3:Seed\-42 paired bootstrap comparison between KernelSynth and Mixed11\. Relative deltas are reported for KernelSynth versus Mixed11; negative values indicate that KernelSynth has lower error, while positive values indicate that Mixed11 has lower error\.ModelMetricStatisticValueMoirai\-SmallCRPSRel\.Δ\\Delta\-0\.2%95% CI\[\-3\.7%, 3\.3%\]Win rate0\.48MASERel\.Δ\\Delta\-1\.9%95% CI\[\-5\.5%, 1\.4%\]Win rate0\.47Chronos\-T5\-MiniCRPSRel\.Δ\\Delta3\.3%95% CI\[\-1\.2%, 8\.2%\]Win rate0\.42MASERel\.Δ\\Delta10\.2%95% CI\[5\.5%, 15\.2%\]Win rate0\.34For Moirai\-Small, KernelSynth and Mixed11 are effectively tied: both CRPS and MASE confidence intervals overlap zero\. For Chronos\-T5\-Mini, Mixed11 is stronger, especially on MASE, where the confidence interval is entirely above zero in favour of Mixed11\. This supports the broader conclusion that multi\-generator mixing can preserve the benefits of a strong individual generator while improving robustness across model families\.
### 3\.3Real–Synthetic Composition
Mixed11 provides a strong synthetic\-only default, but in practical pretraining settings synthetic data is rarely considered in isolation\. The more relevant question is whether synthetic data can complement an available real corpus, or whether it simply dilutes useful real\-world structure\. We therefore blend the real reference corpus with Mixed11 at three window ratios\. For each mixture, we train three independent model initialisations on the same fixed corpus, so the reported variation reflects model\-level stochasticity rather than corpus resampling\. Table[4](https://arxiv.org/html/2606.09912#S3.T4)reports the resulting zero\-shot performance\.
Table 4:Real–synthetic mixture performance on GIFT\-Eval\. Scores are geometric means across evaluation datasets, reported as mean±\\pmstd over three model initialisations\.Real RefandMixed11are the pure\-source endpoints; intermediate rows give the real–synthetic window ratio\. Lower is better; values below 1\.000 beat seasonal naïve\.Boldmarks the lowest mean CRPS per model\.ModelR\-S ratioCRPS↓\\downarrowMASE↓\\downarrowMoirai\-SmallReal Ref0\.830±0\.0140\.830\{\\pm\}0\.0141\.172±0\.0211\.172\{\\pm\}0\.02175\-250\.685±0\.015\\mathbf\{0\.685\{\\pm\}0\.015\}0\.984±0\.023\\mathbf\{0\.984\{\\pm\}0\.023\}50\-500\.710±0\.0150\.710\{\\pm\}0\.0151\.012±0\.0231\.012\{\\pm\}0\.02325\-750\.775±0\.0120\.775\{\\pm\}0\.0121\.100±0\.0211\.100\{\\pm\}0\.021Mixed110\.733±0\.0140\.733\{\\pm\}0\.0141\.058±0\.0221\.058\{\\pm\}0\.022Chronos\-T5\-MiniReal Ref0\.779±0\.0100\.779\{\\pm\}0\.0101\.052±0\.0081\.052\{\\pm\}0\.00875\-250\.794±0\.0110\.794\{\\pm\}0\.0111\.052±0\.0091\.052\{\\pm\}0\.00950\-500\.772±0\.016\\mathbf\{0\.772\{\\pm\}0\.016\}1\.019±0\.014\\mathbf\{1\.019\{\\pm\}0\.014\}25\-750\.780±0\.0100\.780\{\\pm\}0\.0101\.044±0\.0121\.044\{\\pm\}0\.012Mixed110\.899±0\.0150\.899\{\\pm\}0\.0151\.165±0\.0061\.165\{\\pm\}0\.006For Moirai\-Small, adding synthetic data to the real reference corpus gives a clear gain: the 75–25 real–synthetic mixture improves over both pure endpoints on CRPS and MASE\. This suggests that the synthetic mixture is not merely substituting for missing real data, but adding complementary structure under the fixed training budget\. For Chronos\-T5\-Mini, the picture is more conservative\. The 50–50 mixture gives the lowest mean CRPS and MASE, but the CRPS bootstrap interval against the real reference overlaps zero; we therefore interpret this as parity on CRPS and a modest gain on MASE rather than a decisive win\. Overall, the best real–synthetic ratio is architecture\-dependent, and the domain\-level results in Appendix[H](https://arxiv.org/html/2606.09912#A8)show that this dependence also varies across domains and horizons\.
## 4Conclusion
We studied synthetic time\-series pretraining as a corpus composition problem\. Across 11 generator families and two architectures, generator choice produces a factor\-of\-two spread in forecasting error under identical training budgets, and generator rankings differ across architectures and metrics\. An equal\-weight mixture of all generators sidesteps much of this selection problem, matching the strongest individual generator for Moirai\-Small and improving over it for Chronos\-T5\-Mini\. Real–synthetic mixtures clearly improve over both pure\-source baselines for Moirai\-Small and reach parity or modest improvement over the real reference for Chronos\-T5\-Mini\.
These results support a practical lesson: pretraining corpora should be designed and reported explicitly, including generator choice, mixture design, and real–synthetic ratio\. Corpus composition is a first\-order design decision, not a detail to be fixed by convention\. In particular, synthetic data should not be treated as a monolithic category\. Different generators encode different temporal structures, and their usefulness depends on how those structures interact with the model architecture and the downstream evaluation distribution\.
Limitations:Our study is limited to two compact TSFM architectures, a fixed 1M\-window training budget, and a small number of global real–synthetic mixture ratios\. Larger models, longer training, or different downstream benchmarks may change the optimal corpus composition\. Moreover, the domain\-level results suggest that the best composition may vary by domain and horizon rather than following a single global ratio\.
Future work:A natural next step is to estimate the marginal contribution of each generator through leave\-one\-generator\-out or learned mixture\-weight experiments\. More adaptive corpus construction could also condition mixture weights on domain, frequency, horizon, or model family rather than using a single global ratio\. Finally, future work should connect feature\-space diagnostics of synthetic generators with downstream utility, so that corpus design can move from exhaustive empirical sweeps toward predictive rules for selecting and mixing synthetic sources\.
## Impact Statement
This work studies how real and synthetic time\-series corpora can be composed for pretraining time\-series foundation models\. Its primary impact is methodological: it cautions against treating synthetic data as a generic replacement for real data, or treating a synthetic\-data recipe designed for one architecture as automatically transferable to another\. Our results suggest that generator choice, mixture design, and real–synthetic ratios should be treated as explicit corpus design decisions and validated per model family\.
This is especially relevant when real time\-series data is limited, expensive, private, or difficult to share\. In such settings, synthetic data can be a useful complement to availability\-constrained real corpora, but poorly chosen generators or mixture ratios may introduce unrealistic dynamics, miss rare behaviours, or produce models that perform well on aggregate benchmarks while failing in specific domains\. Similarly, real\-only pretraining should not be assumed to be optimal under fixed budgets and practical data constraints\.
Because time\-series models are often used in consequential domains such as healthcare, energy, finance, and infrastructure, corpus composition choices can affect downstream reliability\. We therefore recommend reporting pretraining corpus composition, validating performance across domains, and treating synthetic data as a configurable complement to real data rather than a universal substitute\.
## References
- T\. Aksu, G\. Woo, J\. Liu, X\. Liu, C\. Liu, S\. Savarese, C\. Xiong, and D\. Sahoo \(2024\)GIFT\-Eval: a benchmark for general time series forecasting model evaluation\.arXiv preprint arXiv:2410\.10393\.Cited by:[Appendix D](https://arxiv.org/html/2606.09912#A4.p1.1),[§1](https://arxiv.org/html/2606.09912#S1.p5.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p2.1)\.
- A\. F\. Ansari, L\. Stella, C\. Turkmen, X\. Zhang, P\. Mercado, H\. Shen, O\. Shchur, S\. S\. Rangapuram, S\. P\. Arango, S\. Kapoor, J\. Zschiegner, D\. C\. Maddix, H\. Wang, M\. W\. Mahoney, K\. Torkkola, A\. G\. Wilson, M\. Bohlke\-Schneider, and Y\. Wang \(2024\)Chronos: learning the language of time series\.Transactions on Machine Learning Research\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx6.p1.5),[§1](https://arxiv.org/html/2606.09912#S1.p1.1),[§1](https://arxiv.org/html/2606.09912#S1.p3.1),[§1](https://arxiv.org/html/2606.09912#S1.p5.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1),[§2\.2](https://arxiv.org/html/2606.09912#S2.SS2.p1.1)\.
- F\. Bahrpeyma, M\. Roantree, P\. Cappellari, M\. Scriney, and A\. McCarren \(2021\)A methodology for validating diversity in synthetic time series generation\.MethodsX8,pp\. 101459\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx10.p1.3),[§1](https://arxiv.org/html/2606.09912#S1.p2.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- T\. Bollerslev \(1986\)Generalized autoregressive conditional heteroskedasticity\.Journal of Econometrics31\(3\),pp\. 307–327\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx5.p1.2),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- G\. E\. P\. Box and G\. M\. Jenkins \(1970\)Time series analysis: forecasting and control\.Holden\-Day,San Francisco\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx1.p1.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- A\. Das, W\. Kong, R\. Sen, and Y\. Zhou \(2024\)A decoder\-only foundation model for time\-series forecasting\.InProceedings of the 41st International Conference on Machine Learning,Proceedings of Machine Learning Research, Vol\.235,pp\. 10148–10167\.Cited by:[§1](https://arxiv.org/html/2606.09912#S1.p3.1)\.
- B\. D\. Fulcher and N\. S\. Jones \(2017\)hctsa: a computational framework for automated time\-series phenotyping using massive feature extraction\.Cell Systems5,pp\. 527–531\.e3\.Cited by:[§1](https://arxiv.org/html/2606.09912#S1.p2.1)\.
- D\. T\. Gillespie \(1996\)Exact numerical simulation of the Ornstein\-Uhlenbeck process and its integral\.Physical Review E54\(2\),pp\. 2084–2091\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx7.p1.3),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- L\. R\. Glosten, R\. Jagannathan, and D\. E\. Runkle \(1993\)On the relation between the expected value and the volatility of the nominal excess return on stocks\.Journal of Finance48\(5\),pp\. 1779–1801\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx5.p1.2)\.
- T\. Gneiting and A\. E\. Raftery \(2007\)Strictly proper scoring rules, prediction, and estimation\.Journal of the American Statistical Association102\(477\),pp\. 359–378\.External Links:[Document](https://dx.doi.org/10.1198/016214506000001437)Cited by:[§2\.2](https://arxiv.org/html/2606.09912#S2.SS2.p2.1)\.
- J\. D\. Hamilton \(1989\)A new approach to the economic analysis of nonstationary time series and the business cycle\.Econometrica57\(2\),pp\. 357–384\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx7.p1.3)\.
- J\. D\. Hamilton \(1994\)Time series analysis\.Princeton University Press,Princeton, NJ\.External Links:ISBN 978\-0\-691\-04289\-3Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx1.p1.1)\.
- R\. J\. Hyndman, A\. B\. Koehler, J\. K\. Ord, and R\. D\. Snyder \(2008\)Forecasting with exponential smoothing: the state space approach\.Springer\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx3.p1.3),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- R\. J\. Hyndman and A\. B\. Koehler \(2006\)Another look at measures of forecast accuracy\.International Journal of Forecasting22\(4\),pp\. 679–688\.External Links:[Document](https://dx.doi.org/10.1016/j.ijforecast.2006.03.001)Cited by:[§2\.2](https://arxiv.org/html/2606.09912#S2.SS2.p2.1)\.
- E\. N\. Lorenz \(1963\)Deterministic nonperiodic flow\.Journal of the Atmospheric Sciences20\(2\),pp\. 130–141\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx2.p1.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- C\. H\. Lubba, S\. S\. Sethi, P\. Knaute, S\. R\. Schultz, B\. D\. Fulcher, and N\. S\. Jones \(2019\)Catch22: CAnonical time\-series CHaracteristics\.Data Mining and Knowledge Discovery33,pp\. 1821–1852\.External Links:[Document](https://dx.doi.org/10.1007/s10618-019-00647-x)Cited by:[§1](https://arxiv.org/html/2606.09912#S1.p2.1)\.
- R\. Maat, A\. Malali, and P\. Protopapas \(2017\)TimeSynth: a multipurpose library for synthetic time series generation in Python\.Note:[https://github\.com/TimeSynth/TimeSynth](https://github.com/TimeSynth/TimeSynth)Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx9.p1.2),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- M\. C\. Mackey and L\. Glass \(1977\)Oscillation and chaos in physiological control systems\.Science197\(4300\),pp\. 287–289\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx2.p1.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- B\. B\. Mandelbrot and J\. W\. Van Ness \(1968\)Fractional Brownian motions, fractional noises and applications\.SIAM Review10\(4\),pp\. 422–437\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx4.p1.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- V\. Moroshan, J\. Siems, A\. Zela, T\. Carstensen, and F\. Hutter \(2025\)TempoPFN: synthetic pre\-training of linear RNNs for zero\-shot time series forecasting\.arXiv preprint arXiv:2510\.25502\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx11.p1.5),[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx8.p1.3),[§1](https://arxiv.org/html/2606.09912#S1.p1.1),[§1](https://arxiv.org/html/2606.09912#S1.p3.1),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- D\. B\. Nelson \(1991\)Conditional heteroskedasticity in asset returns: a new approach\.Econometrica59\(2\),pp\. 347–370\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx5.p1.2)\.
- C\. E\. Rasmussen and C\. K\. I\. Williams \(2006\)Gaussian processes for machine learning\.MIT Press\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx6.p1.5),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- G\. E\. Uhlenbeck and L\. S\. Ornstein \(1930\)On the theory of the Brownian motion\.Physical Review36,pp\. 823–841\.Cited by:[Appendix A](https://arxiv.org/html/2606.09912#A1.SSx7.p1.3),[§2\.1](https://arxiv.org/html/2606.09912#S2.SS1.p1.1)\.
- G\. Woo, C\. Liu, A\. Kumar, C\. Xiong, S\. Savarese, and D\. Sahoo \(2024\)Unified training of universal time series forecasting transformers\.InProceedings of the 41st International Conference on Machine Learning,Proceedings of Machine Learning Research, Vol\.235,pp\. 53140–53164\.Cited by:[§1](https://arxiv.org/html/2606.09912#S1.p3.1),[§1](https://arxiv.org/html/2606.09912#S1.p5.1),[§2\.2](https://arxiv.org/html/2606.09912#S2.SS2.p1.1)\.
- S\. M\. Xie, H\. Pham, X\. Dong, N\. Du, H\. Liu, Y\. Lu, P\. Liang, Q\. V\. Le, T\. Ma, and A\. W\. Yu \(2023\)DoReMi: optimizing data mixtures speeds up language model pretraining\.InAdvances in Neural Information Processing Systems,Vol\.36\.Cited by:[§1](https://arxiv.org/html/2606.09912#S1.p4.1)\.
## Appendix ASynthetic Generator Descriptions
Each of the eleven generators produces univariate series of length 1024\. Hyperparameter sampling distributions for all generators are reported in Appendix[B](https://arxiv.org/html/2606.09912#A2)\.
### ARIMA
The ARIMA generator samples a randomized SARIMA\-like process with non\-seasonal ARMA dynamics, optional ordinary integration, and optional seasonal lag structure\(Box and Jenkins,[1970](https://arxiv.org/html/2606.09912#bib.bib12); Hamilton,[1994](https://arxiv.org/html/2606.09912#bib.bib13)\)\. It first simulates an ARMA\(p,q\)\(p,q\)process via
yt=∑j=1pϕjyt−j\+εt\+∑j=1qθjεt−j,εt∼𝒩\(0,σ2\),y\_\{t\}=\\sum\_\{j=1\}^\{p\}\\phi\_\{j\}\\,y\_\{t\-j\}\+\\varepsilon\_\{t\}\+\\sum\_\{j=1\}^\{q\}\\theta\_\{j\}\\,\\varepsilon\_\{t\-j\},\\qquad\\varepsilon\_\{t\}\\sim\\mathcal\{N\}\(0,\\,\\sigma^\{2\}\),\(1\)then optionally adds seasonal AR and MA terms at lag multiples ofmm\. When enabled, the seasonal differencing orderDDis applied before the ordinary integration orderdd\. AR and MA coefficients are accepted only when the corresponding characteristic polynomial roots lie outside the unit circle\. A burn\-in of 500 steps is generated, after which the final length\-LLsegment is retained\.
The corresponding sampling distributions are reported in Table[5](https://arxiv.org/html/2606.09912#A2.T5)\.
### Chaotic
The Chaotic generator draws from two deterministic dynamical systems with equal probability: the Lorenz attractor\(Lorenz,[1963](https://arxiv.org/html/2606.09912#bib.bib16)\)and the Mackey–Glass delay differential equation\(Mackey and Glass,[1977](https://arxiv.org/html/2606.09912#bib.bib17)\)\. The Lorenz system is integrated via fourth\-order Runge–Kutta,
dxdt=σ\(y−x\),dydt=x\(ρ−z\)−y,dzdt=xy−βLz,\\frac\{dx\}\{dt\}=\\sigma\(y\-x\),\\quad\\frac\{dy\}\{dt\}=x\(\\rho\-z\)\-y,\\quad\\frac\{dz\}\{dt\}=xy\-\\beta\_\{L\}z,\(2\)and one coordinate is extracted as the observed series\. The Mackey–Glass equation is integrated via forward Euler,
dxdt=βMx\(t−τ\)1\+x\(t−τ\)n−γMx\(t\)\.\\frac\{dx\}\{dt\}=\\frac\{\\beta\_\{M\}\\,x\(t\-\\tau\)\}\{1\+x\(t\-\\tau\)^\{n\}\}\-\\gamma\_\{M\}\\,x\(t\)\.\(3\)A burn\-in of 2000 steps is discarded in both cases\.
The corresponding sampling distributions are reported in Table[6](https://arxiv.org/html/2606.09912#A2.T6)\.
### ETS
The ETS generator implements the full error–trend–seasonality state\-space family\(Hyndmanet al\.,[2008](https://arxiv.org/html/2606.09912#bib.bib15)\), with error type∈\{A,M\}\\in\\\{\\text\{A\},\\text\{M\}\\\}, trend∈\{N,A,Ad\}\\in\\\{\\text\{N\},\\text\{A\},\\text\{A\}\_\{d\}\\\}, and seasonality∈\{N,A,M\}\\in\\\{\\text\{N\},\\text\{A\},\\text\{M\}\\\}drawn uniformly\. The observation and state\-update equations for the multiplicative\-error, damped\-trend, multiplicative\-seasonality variant are
yt\\displaystyle y\_\{t\}=\(ℓt−1\+ϕbt−1\)st−m\(1\+εt\),\\displaystyle=\(\\ell\_\{t\-1\}\+\\phi b\_\{t\-1\}\)\\,s\_\{t\-m\}\\,\(1\+\\varepsilon\_\{t\}\),\(4\)ℓt\\displaystyle\\ell\_\{t\}=ℓt−1\+ϕbt−1\+αεt\(ℓt−1\+ϕbt−1\),\\displaystyle=\\ell\_\{t\-1\}\+\\phi b\_\{t\-1\}\+\\alpha\\,\\varepsilon\_\{t\}\\,\(\\ell\_\{t\-1\}\+\\phi b\_\{t\-1\}\),bt\\displaystyle b\_\{t\}=ϕbt−1\+β\(ℓt−ℓt−1\),\\displaystyle=\\phi\\,b\_\{t\-1\}\+\\beta\\,\(\\ell\_\{t\}\-\\ell\_\{t\-1\}\),st\\displaystyle s\_\{t\}=st−m\(1\+γεt\),\\displaystyle=s\_\{t\-m\}\\,\(1\+\\gamma\\,\\varepsilon\_\{t\}\),whereεt∼𝒩\(0,σ2\)\\varepsilon\_\{t\}\\sim\\mathcal\{N\}\(0,\\sigma^\{2\}\)\. Additive\-error and additive\-seasonality variants follow analogous recursions\. A burn\-in of 200 steps is discarded\.
The corresponding sampling distributions are reported in Table[7](https://arxiv.org/html/2606.09912#A2.T7)\.
### fBm
The fBm generator produces either fractional Brownian motion or its stationary increments \(fractional Gaussian noise\), governed by the Hurst exponentH∈\(0\.1,0\.9\)H\\in\(0\.1,0\.9\)\(Mandelbrot and Van Ness,[1968](https://arxiv.org/html/2606.09912#bib.bib14)\)\. The covariance structure is
C\(i,j\)=12\(\|i\|2H\+\|j\|2H−\|i−j\|2H\)\.C\(i,j\)=\\tfrac\{1\}\{2\}\\\!\\left\(\|i\|^\{2H\}\+\|j\|^\{2H\}\-\|i\-j\|^\{2H\}\\right\)\.\(5\)Samples are drawn via the Davies–Harte circulant\-embedding method\. The output is scaled bys∼LogUniform\(0\.1,5\.0\)s\\sim\\text\{LogUniform\}\(0\.1,5\.0\)\.
The corresponding sampling distributions are reported in Table[8](https://arxiv.org/html/2606.09912#A2.T8)\.
### GARCH
The GARCH generator draws from three conditional heteroskedasticity models: GARCH\(1,1\)\(Bollerslev,[1986](https://arxiv.org/html/2606.09912#bib.bib3)\), GJR\-GARCH\(Glostenet al\.,[1993](https://arxiv.org/html/2606.09912#bib.bib4)\), and EGARCH\(Nelson,[1991](https://arxiv.org/html/2606.09912#bib.bib5)\)\. All share the mean equationrt=μ\+ϕ\(rt−1−μ\)\+εtr\_\{t\}=\\mu\+\\phi\(r\_\{t\-1\}\-\\mu\)\+\\varepsilon\_\{t\}withεt=σtzt\\varepsilon\_\{t\}=\\sigma\_\{t\}z\_\{t\}\. The variance equations are respectively
σt2\\displaystyle\\sigma^\{2\}\_\{t\}=ω\+αεt−12\+βσt−12,\\displaystyle=\\omega\+\\alpha\\varepsilon^\{2\}\_\{t\-1\}\+\\beta\\sigma^\{2\}\_\{t\-1\},\(6\)σt2\\displaystyle\\sigma^\{2\}\_\{t\}=ω\+\(α\+γ1\[εt−1<0\]\)εt−12\+βσt−12,\\displaystyle=\\omega\+\(\\alpha\+\\gamma\\,\\mathbf\{1\}\[\\varepsilon\_\{t\-1\}<0\]\)\\,\\varepsilon^\{2\}\_\{t\-1\}\+\\beta\\sigma^\{2\}\_\{t\-1\},logσt2\\displaystyle\\log\\sigma^\{2\}\_\{t\}=ω\+α\(\|zt−1\|−𝔼\|z\|\)\+γzt−1\+βlogσt−12\.\\displaystyle=\\omega\+\\alpha\(\|z\_\{t\-1\}\|\-\\mathbb\{E\}\|z\|\)\+\\gamma z\_\{t\-1\}\+\\beta\\log\\sigma^\{2\}\_\{t\-1\}\.Innovationsztz\_\{t\}are drawn from either𝒩\(0,1\)\\mathcal\{N\}\(0,1\)or a standardised Student\-tt\. A burn\-in of 500 steps is discarded\. With probability 0\.5 the output is cumulatively summed to produce an integrated returns series\.
The corresponding sampling distributions are reported in Table[9](https://arxiv.org/html/2606.09912#A2.T9)\.
### KernelSynth
The KernelSynth generator draws samples from a Gaussian process prior\(Ansariet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib1); Rasmussen and Williams,[2006](https://arxiv.org/html/2606.09912#bib.bib2)\),
y∼𝒢𝒫\(m\(𝐱\),k\(𝐱,𝐱′\)\),y\\sim\\mathcal\{GP\}\\\!\\left\(m\(\\mathbf\{x\}\),\\,k\(\\mathbf\{x\},\\mathbf\{x\}^\{\\prime\}\)\\right\),\(7\)where the kernelkkis constructed by randomly composing 1–5 base kernels from a bank of 41, including RBF, Matérn \(ν∈\{0\.5,1\.5,2\.5\}\\nu\\in\\\{0\.5,1\.5,2\.5\\\}\), rational quadratic, periodic \(ExpSineSquared\), dot\-product, and white\-noise kernels, combined via additions \(probability 0\.8\) or products \(probability 0\.2\)\. The mean functionm\(𝐱\)m\(\\mathbf\{x\}\)is sampled with probability 0\.5 from\{linear,quadratic,sinusoidal,log\-linear,random walk\}\\\{\\text\{linear\},\\,\\text\{quadratic\},\\,\\text\{sinusoidal\},\\,\\text\{log\-linear\},\\,\\text\{random walk\}\\\}\.
The corresponding sampling distributions are reported in Table[10](https://arxiv.org/html/2606.09912#A2.T10)\.
### SDE
The SDE generator implements a regime\-switching Ornstein–Uhlenbeck process\(Uhlenbeck and Ornstein,[1930](https://arxiv.org/html/2606.09912#bib.bib7); Hamilton,[1989](https://arxiv.org/html/2606.09912#bib.bib8)\), withK∈\{2,3,4\}K\\in\\\{2,3,4\\\}regimes governed by a Markov transition matrixPP\. Within regimekk, the exact discrete\-time transition\(Gillespie,[1996](https://arxiv.org/html/2606.09912#bib.bib9)\)is
xt\+1=μk\+\(xt−μk\)e−θkΔt\+σk1−e−2θkΔt2θkηt,ηt∼𝒩\(0,1\),x\_\{t\+1\}=\\mu\_\{k\}\+\(x\_\{t\}\-\\mu\_\{k\}\)\\,e^\{\-\\theta\_\{k\}\\Delta t\}\+\\sigma\_\{k\}\\sqrt\{\\frac\{1\-e^\{\-2\\theta\_\{k\}\\Delta t\}\}\{2\\theta\_\{k\}\}\}\\;\\eta\_\{t\},\\quad\\eta\_\{t\}\\sim\\mathcal\{N\}\(0,1\),\(8\)withΔt=1\\Delta t=1\. Regime means\{μk\}\\\{\\mu\_\{k\}\\\}are spaced by random signed offsets of\[1,4\]\[1,4\]; mean\-reversion ratesθk∈\(0\.05,5\.0\)\\theta\_\{k\}\\in\(0\.05,5\.0\)and noise scalesσk∈\(0\.05,2\.0\)\\sigma\_\{k\}\\in\(0\.05,2\.0\)are sampled independently per regime\.
The corresponding sampling distributions are reported in Table[11](https://arxiv.org/html/2606.09912#A2.T11)\.
### StepFunction
The StepFunction generator produces piecewise\-constant series\(Moroshanet al\.,[2025](https://arxiv.org/html/2606.09912#bib.bib6)\)withnseg∼Geometric\(0\.15\)\+2n\_\{\\text\{seg\}\}\\sim\\text\{Geometric\}\(0\.15\)\+2segments whose lengths are drawn from a Dirichlet distribution\. Segment levels follow one of three modes: uniform draws from\[−5,5\]\[\-5,5\], a random walk with Gaussian increments, or cluster\-assigned values\. Transitions between segments are rendered as hard steps, linear ramps, or sigmoid blends over a window of widthmax\(3,⌊U\(0\.01,0\.05\)⋅L⌋\)\\max\\\!\\left\(3,\\,\\lfloor U\(0\.01,0\.05\)\\cdot L\\rfloor\\right\)timesteps\. Gaussian noise is added with probability 0\.7\.
The corresponding sampling distributions are reported in Table[12](https://arxiv.org/html/2606.09912#A2.T12)\.
### TimeSynth
The TimeSynth generator mixes 1–3 signal components drawn from a library of five types — sinusoidal, continuous autoregressive \(CAR\), NARMA, pseudoperiodic, and autoregressive — using the TimeSynth library\(Maatet al\.,[2017](https://arxiv.org/html/2606.09912#bib.bib10)\)\. Components are combined additively \(probability 0\.8\) or multiplicatively, then a noise process drawn uniformly from a bank of 14 Gaussian and red\-noise configurations is added\. The CAR signal satisfies
dxt=−αxtdt\+σdWt,dx\_\{t\}=\-\\alpha\\,x\_\{t\}\\,dt\+\\sigma\\,dW\_\{t\},\(9\)and the NARMA signal follows a nonlinear autoregressive moving\-average recursion of orderr∈\{5,…,14\}r\\in\\\{5,\\ldots,14\\\}\.
The corresponding sampling distributions are reported in Table[13](https://arxiv.org/html/2606.09912#A2.T13)\.
### TSI
The TSI generator constructs series by combining trend \(TT\), seasonality \(SS\), and irregularity \(NN\) components\(Bahrpeymaet al\.,[2021](https://arxiv.org/html/2606.09912#bib.bib11)\), with component types drawn uniformly from parametric families including a null option for each\. Eight combination models are used; the fully multiplicative variant is
yt=Tt\(1\+0\.1St\)\(1\+0\.1Nt\),y\_\{t\}=T\_\{t\}\\,\(1\+0\.1\\,S\_\{t\}\)\\,\(1\+0\.1\\,N\_\{t\}\),\(10\)with additive and mixed forms following analogously\. Trend types include linear, nonlinear, and none; seasonality types include sinusoidal, step, triangular, impulsive, and none; irregularity is drawn from fractional Gaussian noise, fractional Brownian motion, or white noise\.
The corresponding sampling distributions are reported in Table[14](https://arxiv.org/html/2606.09912#A2.T14)\.
### Waveform
The Waveform generator produces mixtures of 1–3 non\-smooth periodic signals\(Moroshanet al\.,[2025](https://arxiv.org/html/2606.09912#bib.bib6)\), targeting asymmetric and discontinuous dynamics absent from GP\-based generators\. Each component is
wt=A⋅f\(2πνt\+φ\),w\_\{t\}=A\\cdot f\\\!\\left\(2\\pi\\nu\\,t\+\\varphi\\right\),\(11\)wheref∈\{sawtooth,square,triangle\}f\\in\\\{\\text\{sawtooth\},\\,\\text\{square\},\\,\\text\{triangle\}\\\}, amplitudeA∼U\(0\.3,3\.0\)A\\sim U\(0\.3,3\.0\), frequencyν∼U\(1,50\)\\nu\\sim U\(1,50\), and phaseφ∼U\(0,2π\)\\varphi\\sim U\(0,2\\pi\)\. An amplitude modulation envelope is applied with probability 0\.3, a linear trend with probability 0\.3, and additive Gaussian noise with probability 0\.7\.
The corresponding sampling distributions are reported in Table[15](https://arxiv.org/html/2606.09912#A2.T15)\.
## Appendix BHyperparameter Distributions
Synthetic generators are instantiated by sampling from broad hyperparameter distributions rather than fixed configurations\. These tables specify the parameter ranges used to construct the synthetic training corpora\.
Table 5:ARIMA hyperparameter sampling distributions\.ParameterSampling ruleppCategorical over\{0,1,2,3\}\\\{0,1,2,3\\\}with weights\[0\.1,0\.3,0\.4,0\.2\]\[0\.1,0\.3,0\.4,0\.2\]; setp=1p\{=\}1ifp=q=0p\{=\}q\{=\}0ddCategorical over\{0,1,2\}\\\{0,1,2\\\}with weights\[0\.4,0\.4,0\.2\]\[0\.4,0\.4,0\.2\]qqCategorical over\{0,1,2,3\}\\\{0,1,2,3\\\}with weights\[0\.1,0\.3,0\.4,0\.2\]\[0\.1,0\.3,0\.4,0\.2\]σ\\sigmaLogUniform\(0\.01,2\.0\)\\mathrm\{LogUniform\}\(0\.01,2\.0\)ϕj\\phi\_\{j\}U\(−0\.8,0\.8\)U\(\-0\.8,0\.8\), with stationarity enforced; fallback toU\(−0\.3,0\.3\)U\(\-0\.3,0\.3\)after 100 failed trialsθj\\theta\_\{j\}U\(−0\.8,0\.8\)U\(\-0\.8,0\.8\), with invertibility enforced; fallback toU\(−0\.3,0\.3\)U\(\-0\.3,0\.3\)after 100 failed trialsSeasonal component, enabled with probability 0\.3mmCategorical over\{4,7,12,24,52\}\\\{4,7,12,24,52\\\}PPCategorical over\{0,1\}\\\{0,1\\\}QQCategorical over\{0,1\}\\\{0,1\\\}; seasonal innovations use𝒩\(0,0\.5σ\)\\mathcal\{N\}\(0,0\.5\\sigma\)DDCategorical over\{0,1\}\\\{0,1\\\}Table 6:Chaotic hyperparameter sampling distributions\.ParameterSampling rulesystemUniform over\{Lorenz,Mackey–Glass\}\\\{\\text\{Lorenz\},\\text\{Mackey\-\-Glass\}\\\}Lorenz systemσ\\sigmaU\(8,12\)U\(8,12\)ρ\\rhoU\(24,30\)U\(24,30\)βL\\beta\_\{L\}U\(2\.0,3\.5\)U\(2\.0,3\.5\)Δt\\Delta tU\(0\.005,0\.02\)U\(0\.005,0\.02\); RK4 integration step sizex0x\_\{0\}U\(−1,1\)3U\(\-1,1\)^\{3\}coordinateUniform over\{0,1,2\}\\\{0,1,2\\\}; extracted observed axisMackey–Glass systemτ\\tauU\(15,30\)U\(15,30\)nnUniform over\{8,9,10,11,12\}\\\{8,9,10,11,12\\\}βM\\beta\_\{M\}U\(0\.15,0\.25\)U\(0\.15,0\.25\)γM\\gamma\_\{M\}U\(0\.05,0\.15\)U\(0\.05,0\.15\)Δt\\Delta tU\(0\.5,2\.0\)U\(0\.5,2\.0\); Euler integration step sizexinitx\_\{\\mathrm\{init\}\}U\(0\.8,1\.0\)U\(0\.8,1\.0\); history initialisationTable 7:ETS hyperparameter sampling distributions\.ParameterSampling ruleerror typeUniform over\{A,M\}\\\{\\text\{A\},\\text\{M\}\\\}trend typeUniform over\{N,A,Ad\}\\\{\\text\{N\},\\text\{A\},\\text\{A\}\_\{d\}\\\}season typeUniform over\{N,A,M\}\\\{\\text\{N\},\\text\{A\},\\text\{M\}\\\}mmUniform over\{4,7,12,24,52\}\\\{4,7,12,24,52\\\}if season type is not Nα\\alphaU\(0\.01,0\.3\)U\(0\.01,0\.3\)β\\betaU\(0\.001,0\.1\)U\(0\.001,0\.1\)if trend type is not Nγ\\gammaU\(0\.001,0\.15\)U\(0\.001,0\.15\)if season type is not Nϕ\\phiU\(0\.8,0\.98\)U\(0\.8,0\.98\)if trend type isAd\\text\{A\}\_\{d\}σM\\sigma\_\{\\mathrm\{M\}\}U\(0\.005,0\.05\)U\(0\.005,0\.05\)if error type is MσA\\sigma\_\{\\mathrm\{A\}\}LogUniform\(0\.01,0\.3\)\\mathrm\{LogUniform\}\(0\.01,0\.3\)if error type is Aℓ0\\ell\_\{0\}U\(10,50\)U\(10,50\); initial levelb0b\_\{0\}U\(−0\.1,0\.1\)U\(\-0\.1,0\.1\)if trend type is not Ns0s\_\{0\}additive𝒩\(0,0\.05ℓ0\)\\mathcal\{N\}\(0,0\.05\\ell\_\{0\}\); mean\-centered initial seasonal statess0s\_\{0\}multiplicativeU\(0\.85,1\.15\)U\(0\.85,1\.15\); normalised to mean 1Table 8:fBm hyperparameter sampling distributions\.ParameterSampling ruleHHU\(0\.1,0\.9\)U\(0\.1,0\.9\); Hurst exponentoutput typeUniform over\{fBm,fGn\}\\\{\\text\{fBm\},\\text\{fGn\}\\\}ssLogUniform\(0\.1,5\.0\)\\mathrm\{LogUniform\}\(0\.1,5\.0\); output scaleTable 9:GARCH hyperparameter sampling distributions\.ParameterSampling rulemodelUniform over\{GARCH,GJR,EGARCH\}\\\{\\text\{GARCH\},\\text\{GJR\},\\text\{EGARCH\}\\\}innovationsUniform over\{𝒩,t\}\\\{\\mathcal\{N\},t\\\}mean typeUniform over\{zero,const,AR1\}\\\{\\text\{zero\},\\text\{const\},\\text\{AR1\}\\\}ν\\nuU\(3,10\)U\(3,10\)if innovations are Student\-ttμ\\mu𝒩\(0,0\.05\)\\mathcal\{N\}\(0,0\.05\)if mean type is constϕ\\phiU\(−0\.3,0\.3\)U\(\-0\.3,0\.3\)if mean type is AR1σunc\\sigma\_\{\\mathrm\{unc\}\}LogUniform\(0\.005,0\.5\)\\mathrm\{LogUniform\}\(0\.005,0\.5\); unconditional volatility used to deriveω\\omegacumsumBernoulli\(0\.5\)\(0\.5\); cumulatively sum output to form an integrated seriesGARCH\(1,1\)persistenceU\(0\.70,0\.97\)U\(0\.70,0\.97\);α\+β\\alpha\+\\betaα\\alphashareU\(0\.02,0\.25\)U\(0\.02,0\.25\);α=persistence×share\\alpha=\\text\{persistence\}\\times\\text\{share\}GJR\-GARCHpersistenceU\(0\.70,0\.97\)U\(0\.70,0\.97\)α\\alphashareU\(0\.02,0\.20\)U\(0\.02,0\.20\)γ\\gammaU\(0\.01,0\.15\)U\(0\.01,0\.15\); leverage effectEGARCHβ\\betaU\(0\.70,0\.97\)U\(0\.70,0\.97\)α\\alphaU\(0\.05,0\.25\)U\(0\.05,0\.25\)γ\\gammaU\(−0\.20,0\.20\)U\(\-0\.20,0\.20\); asymmetry parameterTable 10:KernelSynth hyperparameter sampling distributions\.ParameterSampling rulenumber of kernelsUniform over\{1,2,3,4,5\}\\\{1,2,3,4,5\\\}combination operatorCategorical over\{\+,×\}\\\{\+,\\times\\\}with weights\[0\.8,0\.2\]\[0\.8,0\.2\]; applied pairwisemean flagBernoulli\(0\.5\)\(0\.5\)mean typeUniform over\{linear,quadratic,sinusoidal,log\-linear,RW\}\\\{\\text\{linear\},\\text\{quadratic\},\\text\{sinusoidal\},\\text\{log\-linear\},\\text\{RW\}\\\}if mean flag is enabledLinear mean:at\+bat\+baaU\(−3,3\)U\(\-3,3\)bbU\(−2,2\)U\(\-2,2\)Quadratic mean:at2\+bt\+cat^\{2\}\+bt\+ca,ba,bU\(−2,2\)U\(\-2,2\)ccU\(−1,1\)U\(\-1,1\)Sinusoidal mean:Asin\(2πft\+φ\)A\\sin\(2\\pi ft\+\\varphi\)AAU\(0\.5,3\)U\(0\.5,3\)ffU\(1,8\)U\(1,8\)φ\\varphiU\(0,2π\)U\(0,2\\pi\)Log\-linear mean:alog\(1\+bt\)\+ca\\log\(1\+bt\)\+caaU\(−3,3\)U\(\-3,3\)bbU\(1,20\)U\(1,20\)ccU\(−1,1\)U\(\-1,1\)Random\-walk meanstep stdU\(0\.01,0\.1\)U\(0\.01,0\.1\); cumulative sumTable 11:SDE hyperparameter sampling distributions\.ParameterSampling ruleKKCategorical over\{2,3,4\}\\\{2,3,4\\\}with weights\[0\.5,0\.3,0\.2\]\[0\.5,0\.3,0\.2\]; number of regimesμ0\\mu\_\{0\}U\(−3\.0,3\.0\)U\(\-3\.0,3\.0\); base meanΔμk\\Delta\\mu\_\{k\}U\(1\.0,4\.0\)U\(1\.0,4\.0\)with random sign; offset per regimeθk\\theta\_\{k\}U\(0\.05,5\.0\)U\(0\.05,5\.0\); mean\-reversion rate per regimeσk\\sigma\_\{k\}U\(0\.05,2\.0\)U\(0\.05,2\.0\); noise scale per regimediagonal concentrationU\(15\.0,50\.0\)U\(15\.0,50\.0\); Dirichlet parameter for transition matrixPPinitial regimeUniform over\{0,…,K−1\}\\\{0,\\ldots,K\{\-\}1\\\}Table 12:StepFunction hyperparameter sampling distributions\.ParameterSampling rulensegn\_\{\\mathrm\{seg\}\}Geometric\(0\.15\)\+2\\mathrm\{Geometric\}\(0\.15\)\+2, capped atmax\(3,L/4\)\\max\(3,L/4\)level modeUniform over\{uniform,random walk,clustered\}\\\{\\text\{uniform\},\\text\{random walk\},\\text\{clustered\}\\\}transition typeCategorical over\{hard,ramp,sigmoid\}\\\{\\text\{hard\},\\text\{ramp\},\\text\{sigmoid\}\\\}with weights\[0\.5,0\.3,0\.2\]\[0\.5,0\.3,0\.2\]Dirichlet concentrationU\(0\.5,2\.0\)U\(0\.5,2\.0\); segment length proportionsUniform levelslevelU\(−5,5\)U\(\-5,5\)per segmentRandom\-walk levelsstartU\(−3,3\)U\(\-3,3\)increment stdU\(0\.3,2\.0\)U\(0\.3,2\.0\)Clustered levelsnclustersn\_\{\\mathrm\{clusters\}\}Uniform over\{2,…,min\(5,nseg\)\}\\\{2,\\ldots,\\min\(5,n\_\{\\mathrm\{seg\}\}\)\\\}cluster centersU\(−5,5\)U\(\-5,5\)jitter𝒩\(0,0\.1\)\\mathcal\{N\}\(0,0\.1\)per segmentTransitions, ramp/sigmoid onlywindow widthU\(0\.01,0\.05\)×LU\(0\.01,0\.05\)\\times L, with minimum width of 3 stepssigmoid steepnessU\(5,15\)U\(5,15\)Noisenoise flagBernoulli\(0\.7\)\(0\.7\)noise stdU\(0\.01,0\.3\)U\(0\.01,0\.3\)if noise is enabledTable 13:TimeSynth hyperparameter sampling distributions\.ParameterSampling rulensignalsn\_\{\\mathrm\{signals\}\}Uniform over\{1,2,3\}\\\{1,2,3\\\}signal typeCategorical over\{sin,CAR,NARMA,PP,AR\}\\\{\\text\{sin\},\\text\{CAR\},\\text\{NARMA\},\\text\{PP\},\\text\{AR\}\\\}with weights\[0\.20,0\.25,0\.20,0\.15,0\.20\]\[0\.20,0\.25,0\.20,0\.15,0\.20\]weightwwU\(0\.4,1\.2\)U\(0\.4,1\.2\)per componentcombinationCategorical over\{\+,×\}\\\{\+,\\times\\\}with weights\[0\.8,0\.2\]\[0\.8,0\.2\]irregular probabilityU\(0\.1,0\.3\)U\(0\.1,0\.3\); forced regular for AR/NARMA componentskeep percentageU\(80,95\)U\(80,95\)if irregular sampling is enabledSinusoidal componentperiodppUniform over\{4,…,127\}\\\{4,\\ldots,127\\\}amplitudeU\(0\.5,3\.0\)U\(0\.5,3\.0\)CAR componentα\\alphaU\(0\.1,0\.95\)U\(0\.1,0\.95\); decay parameterσ\\sigmaU\(0\.1,0\.8\)U\(0\.1,0\.8\)start valueU\(−0\.5,0\.5\)U\(\-0\.5,0\.5\)NARMA componentorderrrUniform over\{5,…,14\}\\\{5,\\ldots,14\\\}c1c\_\{1\}U\(0\.6,0\.9\)U\(0\.6,0\.9\)c2c\_\{2\}U\(0\.02,0\.08\)U\(0\.02,0\.08\)c3c\_\{3\}U\(1\.0,2\.0\)U\(1\.0,2\.0\)c4c\_\{4\}U\(0\.05,0\.15\)U\(0\.05,0\.15\)Pseudoperiodic componentperiodppUniform over\{6,…,101\}\\\{6,\\ldots,101\\\}amplitudeU\(0\.5,2\.5\)U\(0\.5,2\.5\)ampSDU\(0\.05,0\.25\)U\(0\.05,0\.25\)freqSDU\(0\.01,0\.15\)×pU\(0\.01,0\.15\)\\times pAutoregressive componentorderppUniform over\{1,2,3\}\\\{1,2,3\\\}ϕj\\phi\_\{j\}U\(−0\.6,0\.6\)U\(\-0\.6,0\.6\)with∑j\|ϕj\|≤0\.9\\sum\_\{j\}\|\\phi\_\{j\}\|\\leq 0\.9σ\\sigmaU\(0\.1,0\.7\)U\(0\.1,0\.7\)Table 14:TSI hyperparameter sampling distributions\.ParameterSampling ruletrend typeUniform over\{linear,nonlinear,none\}\\\{\\text\{linear\},\\text\{nonlinear\},\\text\{none\}\\\}season typeUniform over\{sinusoidal,step,triangular,impulsive,none\}\\\{\\text\{sinusoidal\},\\text\{step\},\\text\{triangular\},\\text\{impulsive\},\\text\{none\}\\\}irregularity typeUniform over\{fGn,fBm,white\}\\\{\\text\{fGn\},\\text\{fBm\},\\text\{white\}\\\}combination modelUniform over\{1,…,8\}\\\{1,\\ldots,8\\\}Linear trend:ct\+dct\+dccU\(−2,2\)U\(\-2,2\)ddU\(−1,1\)U\(\-1,1\)Nonlinear trend:\(at\+b\)sin\(2πt\)\+ct\+d\(at\+b\)\\sin\(2\\pi t\)\+ct\+da,ba,bU\(−1,1\)U\(\-1,1\)ccU\(−2,2\)U\(\-2,2\)ddU\(−1,1\)U\(\-1,1\)Seasonality, sinusoidal/step/triangular/impulsiveperiodUniform over\{4,…,max\(7,L/8\)−1\}\\\{4,\\ldots,\\max\(7,L/8\)\-1\\\}amplitudeU\(0\.5,2\.0\)U\(0\.5,2\.0\)phaseU\(0,2π\)U\(0,2\\pi\)for sinusoidal seasonalityIrregularityHHU\(0\.3,0\.7\)U\(0\.3,0\.7\)for fGn, using AR approximationscaleU\(0\.5,0\.9\)U\(0\.5,0\.9\)for fBm, using normalised cumulative sumstdFixed at0\.20\.2for white noiseTable 15:Waveform hyperparameter sampling distributions\.ParameterSampling rulenwavesn\_\{\\mathrm\{waves\}\}Uniform over\{1,2,3\}\\\{1,2,3\\\}waveform typeUniform over\{sawtooth,square,triangle\}\\\{\\text\{sawtooth\},\\text\{square\},\\text\{triangle\}\\\}per componentAAU\(0\.3,3\.0\)U\(0\.3,3\.0\); amplitude per componentν\\nuU\(1,50\)U\(1,50\); cycles over\[0,1\]\[0,1\]φ\\varphiU\(0,2π\)U\(0,2\\pi\); phase per componentduty cycleU\(0\.2,0\.8\)U\(0\.2,0\.8\)for square wavessawtooth widthUniform over\{0\.0,1\.0\}\\\{0\.0,1\.0\\\}for sawtooth wavesOptional modificationsAM envelopeBernoulli\(0\.3\)\(0\.3\)AM frequencyU\(0\.5,5\.0\)U\(0\.5,5\.0\)if amplitude modulation is enablednoise flagBernoulli\(0\.7\)\(0\.7\)noise stdU\(0\.01,0\.3\)U\(0\.01,0\.3\)if noise is enabledlinear trendBernoulli\(0\.3\)\(0\.3\)trend slopeU\(−2,2\)U\(\-2,2\)if linear trend is enabled
## Appendix CTraining Corpus Construction
Table[16](https://arxiv.org/html/2606.09912#A3.T16)summarises the pretraining corpora used in the downstream experiments\. All conditions use 1M univariate windows of length 1024\. For real–synthetic mixture conditions, three model initialisations are trained per corpus; all single\-generator and Mixed11 conditions use a single run\.
Table 16:Training corpus manifest\. All conditions use 1M windows of length 1024\.ConditionReal windowsSynthetic windowsSynthetic sourceARIMA01,000,000ARIMAChaotic01,000,000ChaoticETS01,000,000ETSfBm01,000,000fBmGARCH01,000,000GARCHKernelSynth01,000,000KernelSynthSDE01,000,000SDEStepFunction01,000,000StepFunctionTimeSynth01,000,000TimeSynthTSI01,000,000TSIWaveform01,000,000WaveformMixed1101,000,000equal mixture of all 11 generatorsReal reference1,000,0000–75\-25 real\-synthetic750,000250,000Mixed11 synthetic source50\-50 real\-synthetic500,000500,000Mixed11 synthetic source25\-75 real\-synthetic250,000750,000Mixed11 synthetic source
## Appendix DReal Reference Corpus: Sampling Details
The real reference corpus is drawn from the GIFT\-Eval pretraining dataset\(Aksuet al\.,[2024](https://arxiv.org/html/2606.09912#bib.bib22)\)\. We sample 1,000,000 univariate windows of length 1024, stratified by frequency and domain where possible\. Because available long\-context real series are unevenly distributed across domains, this corpus is availability\-constrained rather than uniformly balanced\.
#### Allocation Constraints
We apply three constraints when constructing the real reference corpus\. First, datasets with mean series length below 1024 are excluded so that eligible source series can provide length\-1024 windows\. Second, viable frequency–domain strata receive minimum allocations when sufficient supply is available\. Third, per\-dataset caps are applied within strata to reduce dominance by very large sources\.
Interior missing values are forward\- and backward\-filled; trailing missing values are trimmed\. Windows with fewer than 128 valid observations after trimming are discarded\. When a dataset cannot supply its allocated number of valid windows, shortfalls are first retried within the same dataset where possible and then filled from the remaining available datasets\.
#### Sampling Audit
Table[17](https://arxiv.org/html/2606.09912#A4.T17)summarises the final sampling audit for the real reference corpus\. The final sample contains 1,000,000 windows across 126 datasets and 19 viable frequency–domain strata\.
Table 17:Real reference sampling audit computed from final metadata\.QuantityValueFinal sampled windows1,000,000Datasets contributing windows126Viable frequency–domain strata19Backfilled windows2,057Windows with full valid length 1024996,256Windows with valid length<1024<1024after trimming3,744
#### Train–Test Leakage Avoidance
The real reference corpus is sampled from the GIFT\-Eval pretraining pool and excludes downstream evaluation windows used for zero\-shot testing\. The sampled real\-reference corpus is fixed across model seeds\. Therefore, seed\-level variation reflects model initialisation and training stochasticity rather than resampling of the real corpus\.
#### Stratum Coverage
Table[18](https://arxiv.org/html/2606.09912#A4.T18)summarises allocation across viable frequency–domain strata in the final sampled metadata\. The final sample reflects the uneven availability of long\-context real\-world series after applying the viability and allocation constraints\.
Table 18:Allocation across viable frequency–domain strata in the real reference corpus, computed from final sampled metadata\.FreqDomainDatasetsWindowsShareHEnergy20558,59455\.9%5TTransport11160,26916\.0%HClimate3176,1697\.6%6HClimate3369,9877\.0%5TCloudOps351,7745\.2%DWeb113,1551\.3%15TTransport39,7261\.0%30TEnergy39,7261\.0%DClimate39,7261\.0%DEcon/Fin29,7261\.0%DSales29,7261\.0%HTransport38,4720\.8%TEnergy36,7280\.7%HNature23,5920\.4%WHealthcare11,2580\.1%10TEnergy11,0720\.1%30TTransport1276<0\.1%<0\.1\\%4SEnergy216<0\.1%<0\.1\\%DNature18<0\.1%<0\.1\\%Total1261,000,000100%Although the allocation procedure imposes floors and caps, the final corpus remains concentrated because several smaller strata exhaust their available supply, while large long\-series datasets retain substantial headroom\. We therefore treat the real reference as an availability\-constrained reference corpus, not as a uniformly balanced estimate of all time\-series domains\.
## Appendix ETSTR Training Configuration
Table[19](https://arxiv.org/html/2606.09912#A5.T19)reports the shared training configuration used for Chronos\-T5\-Mini and Moirai\-Small\. Both models are trained from random initialisation without pretrained weights\. For each condition, the sampled pretraining corpus is fixed across seeds; only the model initialisation and training seed vary\. Window length denotes the sampled source windows used to construct the pretraining corpora, while context length denotes the model context used during training\.
Table 19:Training configuration for downstream pretraining experiments\.HyperparameterChronos\-T5\-MiniMoirai\-SmallParameters20M13\.8MContext length512512OptimiserAdamWAdamWLearning rate10−310^\{\-3\}10−310^\{\-3\}LR scheduleLinear decayLinear decayDataloader batch size9696Training steps50,00050,000Model seeds42, 43, 4442, 43, 44Pretrained weightsNoneNoneTraining corpus1M windows1M windowsWindow length10241024The configured dataloader batch size is reported rather than a hardware\-specific effective batch size\. Evaluation uses the trained checkpoints zero\-shot; no downstream fine\-tuning is performed on GIFT\-Eval evaluation datasets\.
## Appendix FEvaluation and Aggregation Protocol
All trained checkpoints are evaluated zero\-shot on the 28\-dataset GIFT\-Eval benchmark\. We report normalized CRPS and normalized MASE, matching the metrics used in the main text\. Both metrics are normalized against the seasonal\-naive baseline, so values below 1 indicate improvement over that baseline and lower values are better\.
For each model, condition, seed, dataset, and horizon, we first compute the normalized metric value\. We treat each dataset–horizon pair as an evaluation task\. Aggregate scores in the main text are then computed as geometric means across these task\-level values\. For metric valuesm1,…,mNm\_\{1\},\\ldots,m\_\{N\}acrossNNevaluation tasks, the aggregate is
m¯geo=exp\(1N∑i=1Nlogmi\)\.\\overline\{m\}\_\{\\mathrm\{geo\}\}=\\exp\\left\(\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\log m\_\{i\}\\right\)\.\(12\)
We report the mean and standard deviation of these aggregate scores over model seeds\. The sampled pretraining corpora are fixed across seeds, so the reported seed standard deviations reflect model initialisation and training stochasticity rather than corpus\-resampling variance\.
Domain\-level tables are computed by grouping GIFT\-Eval tasks by thematic domain and forecast horizon\. Missing domain–horizon cells are reported as “–” when no corresponding evaluation dataset is available\.
## Appendix GBootstrap Confidence Intervals
We compute paired bootstrap confidence intervals for the main condition comparisons\. For each model, comparison, and metric, we first aggregate scores by evaluation task and condition\. We then compute paired log differences between the two conditions:
di=logmi\(a\)−logmi\(b\),d\_\{i\}=\\log m\_\{i\}^\{\(a\)\}\-\\log m\_\{i\}^\{\(b\)\},where lower metric values are better\. A negative value therefore means conditionaaoutperforms conditionbb\.
We resample the paired task\-level differences with replacement for 10,000 bootstrap replicates using random seed 42\. Relative deltas are reported as
exp\(1N∑i=1Ndi\)−1,\\exp\\left\(\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}d\_\{i\}\\right\)\-1,with 95% percentile confidence intervals computed from the bootstrap distribution\. We also reportp\(a<b\)p\(a<b\), the fraction of bootstrap replicates in which the first condition has lower error, and the empirical task\-level win rate, defined as the fraction of evaluation tasks on which the first condition achieves lower error, as descriptive statistics\.
The paired bootstrap quantifies uncertainty over sampled evaluation tasks, not uncertainty over pretraining runs\. The single\-generator comparisons use the seed\-42 generator sweep\. The composition comparisons pool the three available composition seeds, 42, 43, and 44, giving 291 paired seed–task observations\. These intervals should therefore be interpreted as task\-level evidence for the reported comparisons, not as definitive estimates of training\-run uncertainty\.
### Best and Second\-Best Single\-Generator Corpora
Table[20](https://arxiv.org/html/2606.09912#A7.T20)compares the best seed\-42 single\-generator corpus against the second\-best single\-generator corpus, Mixed11, and the real\-reference corpus\. KernelSynth is the best single\-generator corpus by average CRPS/MASE rank for both architectures; the second\-best generator is ETS for Moirai\-Small and SDE for Chronos\-T5\-Mini\. Negative relative deltas indicate that the first condition has lower error\.
Table 20:Seed\-42 paired bootstrap comparisons for the best single\-generator corpus against the second\-best single\-generator corpus, Mixed11, and the real\-reference corpus\. Relative deltas are percentages on the normalized metric scale; negative values indicate that the first condition has lower error\.p\(a<b\)p\(a<b\)denotes the fraction of bootstrap replicates in which the first condition has lower error\.ModelComparisonMetricNNRel\.Δ\\Delta95% CIp\(a<b\)p\(a<b\)Win rateMoirai\-SmallKernelSynth vs ETSCRPS97\-10\.6%\[\-14\.9%, \-6\.3%\]1\.000\.62Moirai\-SmallKernelSynth vs ETSMASE97\-9\.1%\[\-13\.3%, \-4\.9%\]1\.000\.62Moirai\-SmallKernelSynth vs Mixed11CRPS97\-0\.2%\[\-3\.7%, 3\.3%\]0\.540\.48Moirai\-SmallKernelSynth vs Mixed11MASE97\-1\.9%\[\-5\.5%, 1\.4%\]0\.850\.47Moirai\-SmallKernelSynth vs Real RefCRPS97\-9\.9%\[\-15\.4%, \-4\.2%\]1\.000\.62Moirai\-SmallKernelSynth vs Real RefMASE97\-8\.7%\[\-13\.6%, \-3\.7%\]1\.000\.62Chronos\-T5\-MiniKernelSynth vs SDECRPS97\-4\.5%\[\-10\.8%, 2\.1%\]0\.910\.59Chronos\-T5\-MiniKernelSynth vs SDEMASE970\.6%\[\-6\.7%, 8\.0%\]0\.420\.48Chronos\-T5\-MiniKernelSynth vs Mixed11CRPS973\.3%\[\-1\.2%, 8\.2%\]0\.080\.42Chronos\-T5\-MiniKernelSynth vs Mixed11MASE9710\.2%\[5\.5%, 15\.2%\]0\.000\.34Chronos\-T5\-MiniKernelSynth vs Real RefCRPS9718\.3%\[10\.8%, 26\.8%\]0\.000\.32Chronos\-T5\-MiniKernelSynth vs Real RefMASE9721\.6%\[13\.9%, 30\.2%\]0\.000\.29For Moirai\-Small, KernelSynth improves over ETS and Real Ref, while its aggregate comparison against Mixed11 is effectively tied for CRPS and slightly favours KernelSynth for MASE\. For Chronos\-T5\-Mini, KernelSynth is not clearly better than SDE, is worse than Mixed11 on MASE, and is clearly worse than the real\-reference corpus\.
### Best Real–Synthetic Mixture versus Pure\-Source Baselines
Table[21](https://arxiv.org/html/2606.09912#A7.T21)compares the best\-performing real–synthetic mixture for each model against the second\-best mixture ratio, the pure synthetic Mixed11 corpus, and the real reference corpus\. Negative relative deltas indicate that the selected real–synthetic mixture has lower error\.
These comparisons assess whether the selected real–synthetic mixture improves over nearby mixture ratios and pure\-source baselines under paired task\-level resampling\. For Moirai\-Small, the 75–25 real–synthetic mixture improves over 50–50, Mixed11, and Real Ref on both metrics\. For Chronos\-T5\-Mini, the 50–50 mixture improves over 25–75 and Mixed11, and is competitive with Real Ref: the CRPS interval overlaps zero, while MASE favours 50–50\.
Table 21:Three\-seed paired bootstrap comparisons for the selected real–synthetic mixture against the second\-best mixture ratio and pure\-source baselines\. Relative deltas are percentages on the normalized metric scale; negative values indicate that the first condition has lower error\.p\(a<b\)p\(a<b\)denotes the fraction of bootstrap replicates in which the first condition has lower error\.ModelComparisonMetricNNRel\.Δ\\Delta95% CIp\(a<b\)p\(a<b\)Win rateMoirai\-Small75\-25 vs 50\-50CRPS291\-3\.6%\[\-5\.3%, \-1\.8%\]1\.000\.59Moirai\-Small75\-25 vs 50\-50MASE291\-2\.8%\[\-4\.4%, \-1\.1%\]1\.000\.64Moirai\-Small75\-25 vs Mixed11CRPS291\-6\.6%\[\-8\.4%, \-4\.7%\]1\.000\.71Moirai\-Small75\-25 vs Mixed11MASE291\-7\.0%\[\-8\.9%, \-5\.2%\]1\.000\.72Moirai\-Small75\-25 vs Real RefCRPS291\-17\.5%\[\-20\.0%, \-15\.0%\]1\.000\.88Moirai\-Small75\-25 vs Real RefMASE291\-16\.0%\[\-18\.3%, \-13\.8%\]1\.000\.88Chronos\-T5\-Mini50\-50 vs 25\-75CRPS291\-1\.5%\[\-2\.9%, \-0\.1%\]0\.980\.57Chronos\-T5\-Mini50\-50 vs 25\-75MASE291\-1\.9%\[\-2\.9%, \-0\.9%\]1\.000\.59Chronos\-T5\-Mini50\-50 vs Mixed11CRPS291\-13\.2%\[\-15\.7%, \-10\.8%\]1\.000\.80Chronos\-T5\-Mini50\-50 vs Mixed11MASE291\-12\.5%\[\-14\.7%, \-10\.3%\]1\.000\.81Chronos\-T5\-Mini50\-50 vs Real RefCRPS291\-1\.0%\[\-3\.6%, 1\.7%\]0\.770\.51Chronos\-T5\-Mini50\-50 vs Real RefMASE291\-3\.1%\[\-5\.3%, \-0\.8%\]0\.990\.61
## Appendix HExtended TSTR Results
This section reports domain\-level zero\-shot results that qualify the aggregate results in Section[3](https://arxiv.org/html/2606.09912#S3)\. Tables are grouped by model family and corpus setting\. These results are intended as evidence for domain\- and horizon\-level heterogeneity, not as additional headline claims\.
For the real–synthetic mixture sweep, we report mean±\\pmstandard deviation across seeds 42, 43, and 44\. Lower values are better throughout\.
### Moirai\-Small
Table 22:Three\-seed real–synthetic mixture domain\-level performance for Moirai\-Small\. Scores are geometric means across evaluation tasks within each domain and horizon, reported as mean±\\pmstandard deviation across seeds 42, 43, and 44\. Condition labels denote real–synthetic window ratios, with Real Ref and Mixed11 as pure\-source endpoints\. Lower is better;boldmarks the best value per domain, horizon, and metric\.DomainR\-S RatioShortMediumLongCRPSMASECRPSMASECRPSMASEEcon/FinReal Ref1\.18±\\pm0\.031\.51±\\pm0\.02––––75\-251\.04±\\pm0\.131\.18±\\pm0\.19––––50\-500\.97±\\pm0\.031\.06±\\pm0\.02––––25\-750\.99±\\pm0\.061\.09±\\pm0\.03––––Mixed111\.10±\\pm0\.121\.24±\\pm0\.15––––EnergyReal Ref0\.95±\\pm0\.001\.16±\\pm0\.011\.15±\\pm0\.021\.55±\\pm0\.021\.31±\\pm0\.071\.90±\\pm0\.1275\-250\.80±\\pm0\.020\.99±\\pm0\.010\.80±\\pm0\.021\.15±\\pm0\.030\.92±\\pm0\.091\.41±\\pm0\.1050\-500\.80±\\pm0\.010\.99±\\pm0\.010\.92±\\pm0\.071\.29±\\pm0\.101\.08±\\pm0\.081\.60±\\pm0\.1125\-750\.83±\\pm0\.011\.03±\\pm0\.011\.23±\\pm0\.061\.64±\\pm0\.071\.31±\\pm0\.021\.92±\\pm0\.08Mixed110\.84±\\pm0\.011\.04±\\pm0\.000\.94±\\pm0\.031\.37±\\pm0\.041\.02±\\pm0\.081\.60±\\pm0\.11HealthcareReal Ref0\.79±\\pm0\.010\.95±\\pm0\.01––––75\-250\.55±\\pm0\.020\.71±\\pm0\.04––––50\-500\.56±\\pm0\.010\.72±\\pm0\.02––––25\-750\.61±\\pm0\.020\.77±\\pm0\.04––––Mixed110\.57±\\pm0\.020\.73±\\pm0\.02––––NatureReal Ref0\.56±\\pm0\.010\.84±\\pm0\.010\.42±\\pm0\.021\.19±\\pm0\.040\.41±\\pm0\.041\.13±\\pm0\.0375\-250\.53±\\pm0\.010\.80±\\pm0\.030\.35±\\pm0\.011\.00±\\pm0\.010\.33±\\pm0\.021\.01±\\pm0\.0250\-500\.52±\\pm0\.000\.79±\\pm0\.000\.35±\\pm0\.011\.03±\\pm0\.030\.36±\\pm0\.021\.06±\\pm0\.0325\-750\.53±\\pm0\.010\.80±\\pm0\.010\.42±\\pm0\.041\.18±\\pm0\.030\.42±\\pm0\.041\.16±\\pm0\.04Mixed110\.54±\\pm0\.000\.80±\\pm0\.010\.39±\\pm0\.011\.04±\\pm0\.050\.38±\\pm0\.021\.07±\\pm0\.07SalesReal Ref0\.46±\\pm0\.000\.75±\\pm0\.00––––75\-250\.44±\\pm0\.000\.73±\\pm0\.00––––50\-500\.45±\\pm0\.000\.73±\\pm0\.01––––25\-750\.45±\\pm0\.000\.73±\\pm0\.00––––Mixed110\.49±\\pm0\.000\.82±\\pm0\.01––––TransportReal Ref0\.66±\\pm0\.010\.78±\\pm0\.020\.75±\\pm0\.021\.00±\\pm0\.010\.81±\\pm0\.021\.17±\\pm0\.0375\-250\.63±\\pm0\.010\.74±\\pm0\.010\.62±\\pm0\.010\.84±\\pm0\.010\.67±\\pm0\.061\.00±\\pm0\.0750\-500\.62±\\pm0\.000\.73±\\pm0\.000\.67±\\pm0\.050\.90±\\pm0\.070\.73±\\pm0\.041\.08±\\pm0\.0625\-750\.63±\\pm0\.010\.74±\\pm0\.010\.81±\\pm0\.061\.06±\\pm0\.080\.82±\\pm0\.031\.19±\\pm0\.06Mixed110\.68±\\pm0\.000\.81±\\pm0\.000\.75±\\pm0\.031\.00±\\pm0\.030\.73±\\pm0\.041\.07±\\pm0\.06Web/CloudOpsReal Ref0\.79±\\pm0\.051\.17±\\pm0\.071\.02±\\pm0\.031\.41±\\pm0\.050\.99±\\pm0\.051\.35±\\pm0\.0675\-250\.56±\\pm0\.030\.86±\\pm0\.040\.89±\\pm0\.001\.24±\\pm0\.010\.94±\\pm0\.031\.30±\\pm0\.0550\-500\.60±\\pm0\.020\.89±\\pm0\.020\.93±\\pm0\.051\.32±\\pm0\.060\.93±\\pm0\.031\.32±\\pm0\.0725\-750\.64±\\pm0\.030\.96±\\pm0\.040\.98±\\pm0\.071\.39±\\pm0\.110\.96±\\pm0\.051\.43±\\pm0\.15Mixed110\.56±\\pm0\.020\.87±\\pm0\.010\.91±\\pm0\.031\.33±\\pm0\.020\.95±\\pm0\.031\.42±\\pm0\.07
### Chronos\-T5\-Mini
Table 23:Three\-seed real–synthetic mixture domain\-level performance for Chronos\-T5\-Mini\. Scores are geometric means across evaluation tasks within each domain and horizon, reported as mean±\\pmstandard deviation across seeds 42, 43, and 44\. Condition labels denote real–synthetic window ratios, with Real Ref and Mixed11 as pure\-source endpoints\. Lower is better;boldmarks the best value per domain, horizon, and metric\.DomainR\-S RatioShortMediumLongCRPSMASECRPSMASECRPSMASEEcon/FinReal Ref0\.89±\\pm0\.011\.02±\\pm0\.01––––75\-250\.88±\\pm0\.030\.88±\\pm0\.01––––50\-500\.91±\\pm0\.030\.87±\\pm0\.01––––25\-750\.87±\\pm0\.030\.89±\\pm0\.02––––Mixed110\.97±\\pm0\.020\.98±\\pm0\.02––––EnergyReal Ref0\.91±\\pm0\.011\.14±\\pm0\.011\.22±\\pm0\.031\.46±\\pm0\.021\.12±\\pm0\.031\.44±\\pm0\.0375\-250\.84±\\pm0\.011\.04±\\pm0\.021\.28±\\pm0\.011\.57±\\pm0\.031\.25±\\pm0\.051\.64±\\pm0\.0650\-500\.81±\\pm0\.010\.99±\\pm0\.011\.21±\\pm0\.011\.49±\\pm0\.021\.23±\\pm0\.061\.58±\\pm0\.0825\-750\.84±\\pm0\.011\.05±\\pm0\.011\.23±\\pm0\.021\.53±\\pm0\.021\.21±\\pm0\.021\.60±\\pm0\.02Mixed110\.92±\\pm0\.021\.13±\\pm0\.021\.62±\\pm0\.011\.92±\\pm0\.021\.53±\\pm0\.061\.94±\\pm0\.07HealthcareReal Ref0\.85±\\pm0\.030\.89±\\pm0\.03––––75\-250\.65±\\pm0\.040\.73±\\pm0\.03––––50\-500\.61±\\pm0\.010\.69±\\pm0\.02––––25\-750\.63±\\pm0\.030\.71±\\pm0\.04––––Mixed110\.67±\\pm0\.030\.77±\\pm0\.05––––NatureReal Ref0\.57±\\pm0\.000\.82±\\pm0\.000\.45±\\pm0\.031\.19±\\pm0\.060\.37±\\pm0\.041\.03±\\pm0\.0675\-250\.56±\\pm0\.010\.81±\\pm0\.010\.48±\\pm0\.031\.10±\\pm0\.030\.39±\\pm0\.031\.09±\\pm0\.0550\-500\.54±\\pm0\.010\.79±\\pm0\.020\.43±\\pm0\.031\.07±\\pm0\.040\.38±\\pm0\.031\.06±\\pm0\.0325\-750\.55±\\pm0\.000\.81±\\pm0\.000\.47±\\pm0\.031\.10±\\pm0\.030\.40±\\pm0\.011\.04±\\pm0\.03Mixed110\.59±\\pm0\.000\.84±\\pm0\.010\.54±\\pm0\.061\.36±\\pm0\.110\.48±\\pm0\.021\.38±\\pm0\.10SalesReal Ref0\.46±\\pm0\.000\.74±\\pm0\.00––––75\-250\.47±\\pm0\.000\.74±\\pm0\.01––––50\-500\.47±\\pm0\.000\.74±\\pm0\.01––––25\-750\.47±\\pm0\.010\.75±\\pm0\.01––––Mixed110\.49±\\pm0\.000\.75±\\pm0\.01––––TransportReal Ref0\.64±\\pm0\.000\.75±\\pm0\.010\.66±\\pm0\.010\.81±\\pm0\.020\.61±\\pm0\.010\.80±\\pm0\.0175\-250\.69±\\pm0\.010\.79±\\pm0\.010\.91±\\pm0\.011\.08±\\pm0\.000\.77±\\pm0\.011\.00±\\pm0\.0050\-500\.67±\\pm0\.010\.78±\\pm0\.000\.88±\\pm0\.021\.05±\\pm0\.020\.78±\\pm0\.031\.00±\\pm0\.0325\-750\.67±\\pm0\.010\.78±\\pm0\.010\.89±\\pm0\.031\.06±\\pm0\.030\.76±\\pm0\.030\.98±\\pm0\.03Mixed110\.74±\\pm0\.000\.85±\\pm0\.011\.12±\\pm0\.051\.31±\\pm0\.030\.95±\\pm0\.031\.21±\\pm0\.02Web/CloudOpsReal Ref0\.58±\\pm0\.000\.93±\\pm0\.001\.05±\\pm0\.091\.40±\\pm0\.091\.13±\\pm0\.041\.41±\\pm0\.0675\-250\.61±\\pm0\.010\.91±\\pm0\.021\.03±\\pm0\.081\.35±\\pm0\.081\.14±\\pm0\.081\.37±\\pm0\.0550\-500\.60±\\pm0\.030\.89±\\pm0\.010\.96±\\pm0\.071\.27±\\pm0\.041\.12±\\pm0\.031\.34±\\pm0\.0225\-750\.61±\\pm0\.020\.90±\\pm0\.031\.02±\\pm0\.131\.32±\\pm0\.071\.12±\\pm0\.001\.36±\\pm0\.03Mixed110\.65±\\pm0\.020\.93±\\pm0\.031\.09±\\pm0\.131\.41±\\pm0\.101\.25±\\pm0\.121\.47±\\pm0\.06
## Appendix ISupplementary Visualizations
### I\.1Per\-Generator PCA Projections
PCA is fit on the real reference corpus only and then applied to each synthetic generator using a fixed preprocessing pipeline: we compute shared window\-level features covering scale, distributional shape, autocorrelation, memory, seasonality, trend, volatility, tail/outlier frequency, changepoint density, missingness, and multivariate dependence where applicable; remove non\-finite or constant dimensions; impute missing values with real\-reference feature medians; standardize using real\-reference scaling parameters; fit PCA on the processed real\-reference matrix; and project each synthetic generator into the resulting coordinate system\.
Figure 1:Per\-generator PCA projections in the audit feature space\. Each panel overlays one synthetic generator with the real reference corpus using the same PCA coordinate system\. The figure is a qualitative diagnostic showing that generators occupy different regions of the audit feature space\.Similar Articles
Data Mixing as Mixture Experiment: Response Surface Methodology and Optimal Design for Large Language Model Pretraining
The paper formulates data mixing for large language model pretraining as a mixture experiment, applying response surface methodology and optimal experimental design to improve the efficiency and interpretability of proxy training runs.
Data Mixing for Large Language Models Pretraining: A Survey and Outlook
This paper presents a comprehensive survey of data mixing methods for LLM pretraining, formalizing the problem as bilevel optimization and introducing a taxonomy that distinguishes static (rule-based and learning-based) from dynamic (adaptive and externally guided) mixing approaches. The authors analyze trade-offs, identify cross-cutting challenges, and outline future research directions including finer-grained domain partitioning and pipeline-aware designs.
From Behavior to Provenance: Attributing Tabular Foundation Models to Synthetic Pretraining Data
This paper proposes using controlled synthetic pretraining with the O'PRIOR task generator to make training-data attribution experimentally verifiable for tabular foundation models, showing that top-attributed task removal measurably degrades held-out performance and revealing that provenance association and interventional faithfulness can diverge.
Scaling Laws for Mixture Pretraining Under Data Constraints
This paper studies the trade-off between scarce target data and abundant generic data in mixture pretraining, finding that repetition is a key driver of performance and that mixture training tolerates 15-20 repetitions of target data. It introduces a repetition-aware scaling law to optimize mixture configurations under data constraints.
Always Learning, Always Mixing: Efficient and Simple Data Mixing All The Time
This paper introduces OP-Mix, a data mixing algorithm that uses low-rank adapters trained on the current model to cheaply simulate candidate data mixtures, enabling efficient and unified data mixing across pretraining, continual midtraining, and continual instruction tuning. OP-Mix consistently finds near-optimal mixtures while using a fraction of the compute of baselines, improving pretraining perplexity by 6.3% and reducing compute by 66-95% in continual learning settings.