Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Models

arXiv cs.LG Papers

Summary

This paper identifies 'suboptimal collapse' in RL post-training of time series foundation models and proposes Ground-Truth Neighborhood Regularization (GTN-R) to keep output distributions near the ground truth, improving forecasting performance.

arXiv:2608.08010v1 Announce Type: new Abstract: Time series forecasting (TSF) plays an important role in a wide range of real-world applications. Recently, time series foundation models (TSFMs), pretrained on large-scale datasets, have demonstrated strong generalization capabilities and emerged as an important paradigm for TSF. Reinforcement learning (RL) post-training has consequently attracted growing attention as a means of further improving their performance on downstream tasks. However, we find that, in certain forecast regions, RL post-training may gradually shift the output distributions of TSFMs away from the ground truth, thereby limiting their performance. We refer to this phenomenon as \textbf{suboptimal collapse}. Our analysis suggests that difficulty in initially sampling high-quality trajectories near the ground truth is an important contributing factor to suboptimal collapse. To address this issue, we propose Ground-Truth Neighborhood Regularization (GTN-R) for RL post-training of TSFMs. GTN-R uses the ground truth as a reference for locating high-quality regions and guides the model's probability mass toward the ground-truth neighborhood. This increases the probability of sampling high-quality trajectories, mitigates suboptimal collapse, and improves performance. Moreover, GTN-R can be flexibly integrated into various RL methods for TSFMs. Extensive experiments show its effectiveness.
Original Article
View Cached Full Text

Cached at: 08/11/26, 08:09 AM

# Ground-Truth Neighborhood Regularization for Reinforcement Learning Post-Training of Time Series Foundation Models
Source: [https://arxiv.org/html/2608.08010](https://arxiv.org/html/2608.08010)
###### Abstract

Time series forecasting \(TSF\) plays an important role in a wide range of real\-world applications\. Recently, time series foundation models \(TSFMs\), pretrained on large\-scale datasets, have demonstrated strong generalization capabilities and emerged as an important paradigm for TSF\. Reinforcement learning \(RL\) post\-training has consequently attracted growing attention as a means of further improving their performance on downstream tasks\. However, we find that, in certain forecast regions, RL post\-training may gradually shift the output distributions of TSFMs away from the ground truth, thereby limiting their performance\. We refer to this phenomenon assuboptimal collapse\. Our analysis suggests that difficulty in initially sampling high\-quality trajectories near the ground truth is an important contributing factor to suboptimal collapse\. To address this issue, we propose Ground\-Truth Neighborhood Regularization \(GTN\-R\) for RL post\-training of TSFMs\. GTN\-R uses the ground truth as a reference for locating high\-quality regions and guides the model’s probability mass toward the ground\-truth neighborhood\. This increases the probability of sampling high\-quality trajectories, mitigates suboptimal collapse, and improves performance\. Moreover, GTN\-R can be flexibly integrated into various RL methods for TSFMs\. Extensive experiments show its effectiveness\.

Preprint\. Under review\.

## Introduction

Time series forecasting \(TSF\) is a fundamental task in a wide range of applications, including energy scheduling\(Boussifet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib476); Novoet al\.[2022](https://arxiv.org/html/2608.08010#bib.bib477); Lara\-Benítezet al\.[2020](https://arxiv.org/html/2608.08010#bib.bib607); Debet al\.[2017](https://arxiv.org/html/2608.08010#bib.bib469)\), traffic management\(Fanget al\.[2023](https://arxiv.org/html/2608.08010#bib.bib457); Liet al\.[2022](https://arxiv.org/html/2608.08010#bib.bib456); Wanget al\.[2022](https://arxiv.org/html/2608.08010#bib.bib472); Shekhar and Williams[2007](https://arxiv.org/html/2608.08010#bib.bib468)\), and weather forecasting\(Abhisheket al\.[2012](https://arxiv.org/html/2608.08010#bib.bib416); Karevan and Suykens[2020](https://arxiv.org/html/2608.08010#bib.bib474); Campbell and Diebold[2005](https://arxiv.org/html/2608.08010#bib.bib473); Hamiltonet al\.[2007](https://arxiv.org/html/2608.08010#bib.bib467)\)\. Recently, time series foundation models \(TSFMs\), pretrained on large\-scale time series data, have demonstrated strong generalization across diverse scenarios\(Wooet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib596)\)\. However, the general capabilities acquired during pretraining may not fully adapt to specific downstream tasks, making post\-training necessary to improve performance in target scenarios further\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223)\)\. Recent studies\(Qiet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib150); Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\)have shown that, compared with supervised fine\-tuning \(SFT\), reinforcement learning \(RL\) post\-training can more effectively unlock the forecasting capabilities of TSFMs on downstream tasks, thereby attracting increasing attention\.

![Refer to caption](https://arxiv.org/html/2608.08010v1/x1.png)Figure 1:Illustration of suboptimal collapse during RL post\-training of Moirai\-small\. Each row shows the evolving predictive distribution for a training sample, with the RL method, processed epoch, and MSE reported above each panel\. The TSFM used is Moirai\-small\.As training progresses, distribution within the yellow boxes shifts toward regions far from the ground truth, indicating suboptimal collapse\. More results are in Appendix “More Visualization\.”Although RL post\-training improves the forecasting performance of TSFMs, we identify a notable issue during training\. Specifically, ideally, as training progresses, the model’s predictive distribution should gradually concentrate around the ground truth\. However, we observe that, in many cases, although the overall MSE decreases, the predictive distribution in some regions \(yellow boxes\) gradually concentrates outside the ground\-truth neighborhood, as shown in Fig\.[1](https://arxiv.org/html/2608.08010#Sx1.F1)\. We term this phenomenonsuboptimal collapse\. It may trap subsequent optimization in low\-quality regions far from the ground truth and limit forecasting performance\. From an optimization perspective, suboptimal collapse may arise because the model initially struggles to sample high\-quality trajectories near the ground truth in certain regions\. In this case, the relatively better trajectories within a sampled group are often located in low\-quality regions far from the ground truth\. Since RL optimizes the model by increasing the probabilities of relatively better trajectories\(Qiet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib150); Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\), updates in the above sampled group further widen the probability gap between the low\-quality region and the ground\-truth neighborhood\. This makes the model more likely to sample trajectories from the low\-quality region and, consequently, makes the relatively better trajectories in subsequent sampled groups more likely to be in the low\-quality region\. Repeated occurrences of this process form a detrimental self\-reinforcing cycle, which may eventually drive the probability of the ground\-truth neighborhood toward zero, thereby leading to suboptimal collapse\. In Sections “Theoretical Analysis” and “Empirical Analysis”, we further validate this intuitive conjecture from theoretical and empirical perspectives, respectively\.

An intuitive solution is to directly include the ground\-truth trajectory in the sampled group\. However, because the ground\-truth participates in the updates as a fixed sample with the highest reward, the model may instead learn to imitate it in a supervised manner, causing RL post\-training to gradually degenerate into a process resembling behavior cloning\(Yanet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib109)\)\. This may weaken the model’s exploration capability and further impair its generalization ability\(Wanget al\.[2025](https://arxiv.org/html/2608.08010#bib.bib470); Weltevredeet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib471); Chuet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib589)\)\. Our experiments in Section “Empirical Analysis” further support this argument: although this approach mitigates suboptimal collapse on the training data, it undermines the model’s exploration capability and generalization performance\. Therefore, although the ground\-truth trajectory can serve as a reference for high\-quality trajectories, it should not participate in the updates as a fixed high\-reward sample\.

Based on the above analysis, we propose Ground\-Truth Neighborhood Regularization \(GTN\-R\), a regularization method for RL post\-training of TSFMs\. Instead of directly including the ground truth in the updates as a fixed high\-reward sample, GTN\-R uses it only as a reference for high\-quality trajectories, guiding the model to increase the probability of sampling high\-quality trajectories\. Consequently, GTN\-R mitigates suboptimal collapse while preserving the model’s autonomous exploration capability, thereby further improving performance\. Specifically, GTN\-R introduces two distributional constraints into the original RL objective: the neighborhood probability mass constraint and the within\-neighborhood uniformity constraint\. The former maximizes the probability mass assigned by the predictive distribution to the ground\-truth neighborhood, thereby increasing the probability of sampling high\-quality trajectories and mitigating suboptimal collapse\. The latter encourages the distribution within this neighborhood to approach a uniform distribution, preventing probability mass from concentrating at only a few locations and thus preserving the model’s exploration ability\. We integrate GTN\-R into multiple RL methods applicable to TSFMs\. Experiments across multiple TSFMs and datasets show that GTN\-R effectively mitigates suboptimal collapse and improves performance\.

Our contributions are as follows:1\)We identifysuboptimal collapsein RL post\-training of TSFMs and, through theoretical analysis and empirical studies, investigate its mechanism and negative impact on forecasting performance\.2\)To address this issue, we propose GTN\-R, which mitigates suboptimal collapse by increasing the probability mass assigned to the ground\-truth neighborhood while encouraging a near\-uniform distribution within it, thereby improving forecasting performance\.3\)We validate the effectiveness of GTN\-R across multiple RL methods for TSFMs\.

## Related Work

Recently, Time Series Foundation Models \(TSFMs\) have advanced rapidly\(Milleret al\.[2024](https://arxiv.org/html/2608.08010#bib.bib446); Kottapalliet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib611); Yeet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib606); Liuet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib605)\)\. Some TSFMs, such as Moment\(Goswamiet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib160)\), UniTS\(Gaoet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib158)\), TimesFM\(Daset al\.[2024](https://arxiv.org/html/2608.08010#bib.bib157)\), and Timer\(Liuet al\.[2024b](https://arxiv.org/html/2608.08010#bib.bib122)\), produce deterministic forecasts\. However, stochastic disturbances, observation noise, and environmental changes make future time series inherently uncertain\(Clark and Bjørnstad[2004](https://arxiv.org/html/2608.08010#bib.bib609); Yoonet al\.[2022](https://arxiv.org/html/2608.08010#bib.bib608)\)\. Deterministic predictions cannot capture multiple possible futures or quantify predictive confidence, thereby limiting their ability to support uncertainty\-aware decision\-making in real\-world\(Liuet al\.[2024a](https://arxiv.org/html/2608.08010#bib.bib133)\)\. This has motivated probabilistic TSFMs \(Moirai\(Wooet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib596)\), Moirai\-MoE\(Liuet al\.[2024a](https://arxiv.org/html/2608.08010#bib.bib133)\), and Toto\(Cohenet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib132)\)\), which produced the distribution of future series\.

For downstream\-task post\-training, the research community initially relies on supervised fine\-tuning \(SFT\) to optimize TSFMs\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223)\)\. However,\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223); Qiet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib150); Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\)shows that naive SFT cannot fully unlock TSFMs’ forecasting potential\. Recent studies\(Qiet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib150); Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\), therefore, apply RL methods, such as RLHF\(Ouyanget al\.[2022](https://arxiv.org/html/2608.08010#bib.bib149)\)and GRPO\(Shaoet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib134)\), to TSFM post\-training and achieve better performance than SFT\. However, we find that directly applying RL may lead to suboptimal collapse, as shown in Fig\.[1](https://arxiv.org/html/2608.08010#Sx1.F1)\. This paper aims to mitigate suboptimal collapse in RL post\-training of TSFMs and further improve forecasting performance\.

## Preliminaries

### Time Series Forecasting \(TSF\)\.

In TSF, given a historical seriesX∈ℝTh×NX\\in\\mathbb\{R\}^\{T\_\{h\}\\times N\}, whereThT\_\{h\}is the input length,NNis the number of variables, the task is to predict the series of the nextTfT\_\{f\}time stepsY∈ℝTf×NY\\in\\mathbb\{R\}^\{T\_\{f\}\\times N\}\.

### Probabilistic Forecasting and Sampling in TSFMs

In this paper, we focus on probabilistic TSFMs because they explicitly model predictive distributions of future series, from which RL can conveniently sample trajectories for update\. Probabilistic TSFMs mainly adopt two forecasting paradigms: one\-shot forecasting and token\-by\-token forecasting\(Liuet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib610)\)\. We next describe how these two get future predictive distributions and sample trajectories\.

We first introduce the one\-shot forecasting paradigm, which is adopted by Moirai\(Wooet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib596)\)\. Given a historical seriesXX, the model simultaneously predicts the distributions of all future time points through a single forward pass, yielding the set of all predictive distributions:

fθ​\(X\)=\{P​\(y^1∣X\),…,P​\(y^Tf∣X\)\}=𝒫,f\_\{\\theta\}\(X\)=\\\{P\(\\hat\{y\}\_\{1\}\\mid X\),\.\.\.,P\(\\hat\{y\}\_\{T\_\{f\}\}\\mid X\)\\\}=\\mathcal\{P\},\(1\)wherefθf\_\{\\theta\}denotes the forecasting function andP​\(y^t∣X\)P\(\\hat\{y\}\_\{t\}\\mid X\)the predictive distribution of thett\-th point ofY^\\hat\{Y\}\. We then sample from the point\-wise distributions in𝒫\\mathcal\{P\}to construct multiple trajectories for training:

\{Y^i\}i=1n∼𝒫\.\\\{\\hat\{Y\}^\{i\}\\\}\_\{i=1\}^\{n\}\\sim\\mathcal\{P\}\.\(2\)
We next introduce the token\-by\-token forecasting paradigm, which is adopted by Moirai\-MoE\(Liuet al\.[2024a](https://arxiv.org/html/2608.08010#bib.bib133)\)and Toto\(Cohenet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib132)\)\. Given a historical seriesXX, the future seriesYYis divided into contiguous segments of equal length\{Ys​1,Ys​2,…\}\\\{Y\_\{s1\},Y\_\{s2\},\\ldots\\\}, each corresponding to one token\. The model first predicts the distribution of each point inYs​1Y\_\{s1\}:

fθ​\(X\)=\{P​\(y^s​1,1∣X\),…,P​\(y^s​1,Tp∣X\)\}=𝒫s​1,f\_\{\\theta\}\(X\)=\\\{P\(\\hat\{y\}\_\{s1,1\}\\mid X\),\.\.\.,P\(\\hat\{y\}\_\{s1,T\_\{p\}\}\\mid X\)\\\}=\\mathcal\{P\}\_\{s1\},\(3\)whereTpT\_\{p\}is the length of each patch,P​\(y^s​1,t∣X\)P\(\\hat\{y\}\_\{s1,t\}\\mid X\)is thett\-th\-point predictive distribution ofY^s​1\\hat\{Y\}\_\{s1\}\. We then sample from the point\-wise distributions in𝒫s​1\\mathcal\{P\}\_\{s1\}to construct multiple segment\-level trajectories:

\{Y^s​1i\}i=1n∼𝒫s​1\.\\\{\\hat\{Y\}\_\{s1\}^\{i\}\\\}\_\{i=1\}^\{n\}\\sim\\mathcal\{P\}\_\{s1\}\.\(4\)Next, for eachY^s​1i\\hat\{Y\}\_\{s1\}^\{i\}, we concatenate it with the existing series to form a new series\(X,Y^s​1i\)\(X,\\hat\{Y\}\_\{s1\}^\{i\}\)\. Then it is fed into the model to predict the distribution of each point of the next segment,𝒫s​2i\\mathcal\{P\}\_\{s2\}^\{i\}=\{P​\(y^s​2,t∣X,Y^s​1i\)\}t=1Tp\\\{P\(\\hat\{y\}\_\{s2,t\}\\mid X,\\hat\{Y\}\_\{s1\}^\{i\}\)\\\}\_\{t=1\}^\{T\_\{p\}\}\. Next, we sample only one segment\-level trajectory from𝒫s​2i\\mathcal\{P\}\_\{s2\}^\{i\}as the continuation ofY^s​1i\\hat\{Y\}\_\{s1\}^\{i\}\. This process is repeated until each trajectory reaches the required prediction length\.

![Refer to caption](https://arxiv.org/html/2608.08010v1/x2.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.08010v1/x3.png)\(b\)
![Refer to caption](https://arxiv.org/html/2608.08010v1/x4.png)\(c\)

Figure 2:\(a\) Mean log probability assigned to the ground\-truth neighborhoods of collapsed and non\-collapsed points during post\-training\. Mean ground\-truth\-neighborhood log probability \(b\) and sampling variance \(c\) with and without including the ground\-truth trajectory\. Train step denotes the number of processed batches\. In \(c\),×101\\times 10^\{1\}indicates that the actual variances of the dataset are 10 times the plotted values\.![Refer to caption](https://arxiv.org/html/2608.08010v1/x5.png)Figure 3:Test\-set forecasting performance with and without including the ground\-truth trajectory in the sampled group\.

## Theoretical Analysis

In this section, we theoretically analyze a possible mechanism that may lead to suboptimal collapse\. For a given future time pointttand its predictive context𝒞t\\mathcal\{C\}\_\{t\}, let𝒢=𝒩r​\(yt\)\\mathcal\{G\}=\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)be the ground\-truth neighborhood, and let𝒮\\mathcal\{S\}be a low\-quality region such that𝒢∩𝒮=∅\\mathcal\{G\}\\cap\\mathcal\{S\}=\\varnothing\. Their union is not required to cover the entire point\-wise prediction space\. Letpθk,t\(⋅∣𝒞t\)p\_\{\\theta\_\{k\},t\}\(\\cdot\\mid\\mathcal\{C\}\_\{t\}\)be the model’s predictive probability at iterationkk\. We define:

pk=pθk,t​\(𝒢∣𝒞t\),sk=pθk,t​\(𝒮∣𝒞t\)\.p\_\{k\}=p\_\{\\theta\_\{k\},t\}\(\\mathcal\{G\}\\mid\\mathcal\{C\}\_\{t\}\),\\qquad s\_\{k\}=p\_\{\\theta\_\{k\},t\}\(\\mathcal\{S\}\\mid\\mathcal\{C\}\_\{t\}\)\.\(5\)Suppose thatMMtrajectories are independently sampled at each iteration, and lety^ti\\hat\{y\}\_\{t\}^\{i\}denote the prediction at time pointttin theii\-th trajectory\. LetEkE\_\{k\}denote the event that at least one sampled prediction lies in𝒢\\mathcal\{G\}, i\.e\.,y^ti∈𝒢\\hat\{y\}\_\{t\}^\{i\}\\in\\mathcal\{G\}for someii, and letEkcE\_\{k\}^\{c\}denote its complement\. We further letAkA\_\{k\}denote the event thatEkcE\_\{k\}^\{c\}occurs and the predictions at time pointttin the positively reinforced trajectories \(i\.e\., the better trajectories among theMMsamples\) lie in𝒮\\mathcal\{S\}\.

Our analysis is based on the following conditions\.

Initial sampling difficulty\.The probabilitypkp\_\{k\}assigned to the ground\-truth neighborhood at time pointttis low\.

Low\-quality\-dominance update\.When no sampled prediction at time pointttlies in𝒢\\mathcal\{G\}, the values of the points of better trajectories that dominate the update are likely to lie in a certain low\-quality region𝒮\\mathcal\{S\}\. Formally, there exists a sufficiently largeρ∈\(0,1\)\\rho\\in\(0,1\)such that

p​\(Ak∣ℱk,Ekc\)≥ρ,p\(A\_\{k\}\\mid\\mathcal\{F\}\_\{k\},E\_\{k\}^\{c\}\)\\geq\\rho,\(6\)whereℱk\\mathcal\{F\}\_\{k\}denotes the training history before iterationkk\.

Relative amplification\.Since RL updates increase the probabilities of relatively better sampled trajectories\(Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\), whenAkA\_\{k\}occurs, the update increases the probability of𝒮\\mathcal\{S\}more than that of𝒢\\mathcal\{G\}:

sk\+1sk≥\(1\+η\)​pk\+1pk,η\>0\.\\frac\{s\_\{k\+1\}\}\{s\_\{k\}\}\\geq\(1\+\\eta\)\\frac\{p\_\{k\+1\}\}\{p\_\{k\}\},\\eta\>0\.\(7\)We emphasize that these conditions characterize a possible failure mode and need not hold for every update of a specific RL method\. Then, we can derive:

###### Proposition 1\.

Under the above conditions, wheneverAkA\_\{k\}occurs, after the update, the lower bound on the probability of the next low\-quality\-dominated update at time pointttincreases:

p​\(Ak\+1∣ℱk\+1\)≥ρ​\(1−hk\+1\)M,p\(A\_\{k\+1\}\\mid\\mathcal\{F\}\_\{k\+1\}\)\\geq\\rho\(1\-h\_\{k\+1\}\)^\{M\},\(8\)wherehk=pkpk\+skh\_\{k\}=\\frac\{p\_\{k\}\}\{p\_\{k\}\+s\_\{k\}\}\. If such updates occur forLLconsecutive iterations, then

pk\+L≤11\+\(1\+η\)L​sk/pk⟶0as​L→∞\.p\_\{k\+L\}\\leq\\frac\{1\}\{1\+\(1\+\\eta\)^\{L\}s\_\{k\}/p\_\{k\}\}\\longrightarrow 0\\qquad\\text\{as \}L\\rightarrow\\infty\.\(9\)

Proposition[1](https://arxiv.org/html/2608.08010#Thmproposition1)characterizes a sufficient self\-reinforcing mechanism for suboptimal collapse at a forecasting point\. Intuitively, when the initial probability assigned to its ground\-truth neighborhood is low \(i\.e\.,p0p\_\{0\}is low\), a low\-quality\-dominated update \(A0A\_\{0\}\) is more likely to occur\. Once such an update occurs, Eq\.[8](https://arxiv.org/html/2608.08010#Sx4.E8)shows that the lower bound on the probability of the next low\-quality\-dominated update increases, making such updates more likely to persist\. If this process persists, Eq\.[9](https://arxiv.org/html/2608.08010#Sx4.E9)implies that the ground\-truth\-neighborhood probability at this forecasting point can approach zero, leading to suboptimal collapse\.

## Empirical Analysis

In this section, we provide empirical evidence consistent with the self\-reinforcing process characterized in Proposition[1](https://arxiv.org/html/2608.08010#Thmproposition1)and investigate the effect of adding the ground\-truth trajectory to the sampled group during training\.

In the first experiment, we empirically analyze suboptimal collapse\. Specifically, we select three TSFMs as backbones—Moirai\-small\(Wooet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib596)\), Toto\(Cohenet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib132)\), and Moirai\-MoEs\(Liuet al\.[2024a](https://arxiv.org/html/2608.08010#bib.bib133)\)\. And we apply TPO\(Qiet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib150)\), TimeRFT\(Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\), and TS\-GRPO, respectively, for RL post\-training\. TS\-GRPO is a simple GRPO\-based post\-training method applicable to different TSFMs, with implementation details provided in Appendix "TS\-GRPO"\. We first perform a complete RL post\-training run\. We then randomly select 1,000 training samples and identify the time points at which collapse does and does not occur in these samples\. After training, a time point is considered collapsed if its ground\-truth\-neighborhood probability is below 0\.001\. The neighborhood radius is set to 1 for Loop Seattle and 0\.1 for all other datasets\. We then retrain the models and record, throughout training, the mean log probability assigned by the model’s output distribution to the ground\-truth neighborhoods of these two groups of points\. The results are shown in Fig\.[2a](https://arxiv.org/html/2608.08010#Sx3.F2.sf1)\. We observe that: 1\) regions of collapse typically have lower initial ground\-truth\-neighborhood probability, which further decreases during training; and 2\) regions of non\-collapse have higher initial probability, which continues to increase throughout training\. These results are consistent with the conditional self\-reinforcing process characterized in Proposition[1](https://arxiv.org/html/2608.08010#Thmproposition1): when the model initially struggles to sample high\-quality trajectories in certain regions, a detrimental self\-reinforcing cycle can emerge, eventually leading to suboptimal collapse\.

In the second experiment, we examine the effect of adding the ground\-truth trajectory to the sampled group during training\. Specifically, the TSFMs, RL methods, and observed train data selection settings are the same as those described above\. We train the models under two settings: with and without the ground\-truth trajectory included\. We clip the ground\-truth reward at 1\.5 times the maximum sampled reward within its group to prevent an excessively high ground\-truth reward from compromising training stability\. During training, we record three metrics: 1\) the mean log probability assigned by the model’s output distribution to the ground\-truth neighborhoods of these selected samples; 2\) the sampling variance of the predictive trajectories for these selected samples; and 3\) the forecasting performance of the trained model on the test set\. The results are in Fig\.[2b](https://arxiv.org/html/2608.08010#Sx3.F2.sf2),[3](https://arxiv.org/html/2608.08010#Sx3.F3)and[2c](https://arxiv.org/html/2608.08010#Sx3.F2.sf3)\. We observe that directly adding the ground\-truth trajectory substantially increases the probability of the ground\-truth neighborhood, thereby mitigating suboptimal collapse\. However, both the sampling variance and test\-set performance decrease\. These results indicate that the ground\-truth trajectory can serve as a reference for high\-quality trajectories to mitigate suboptimal collapse, but should not directly participate in policy updates as a fixed high\-reward sample\.

![Refer to caption](https://arxiv.org/html/2608.08010v1/x6.png)Figure 4:Overall framework of our method\.
## Method

In this section, we propose GTN\-R, a regularization method for RL post\-training of TSFMs\. GTN\-R uses the ground truth only to identify high\-quality regions and increase the probability of sampling trajectories from them, without directly incorporating ground\-truth trajectories into policy updates\. This mitigates suboptimal collapse while preserving exploration, thereby improving performance\. Specifically, we first introduce the overall pipeline, then describe the regularization constraints, and finally present the learning objective\.

### Overall Pipeline

In this subsection, we introduce the overall pipeline of GTN\-R\. Fig\.[4](https://arxiv.org/html/2608.08010#Sx5.F4)illustrates the overall training framework of GTN\-R\. Specifically, we adopt a TSFM capable of producing predictive distributions as the backbone model\. Given a train date, we compute the Ground\-Truth Neighborhood Regularization term, as detailed in the next subsection, and incorporate it into the original training objective\. Finally, we update the model using the resulting objective under the RL paradigm\.

### Ground\-Truth Neighborhood Regularization

In this subsection, we describe how to compute the proposed regularization terms based on the ground\-truth neighborhood\. Specifically, we first formally define the ground\-truth neighborhood\. We then introduce how to get the first regularization term: the neighborhood probability mass constraint\. Finally, we introduce how to get the second regularization term: the within\-neighborhood uniformity constraint\.

Firstly, we formally define the ground\-truth neighborhood\. Given a historical seriesXXand the corresponding ground\-truth future series:

Y=\{y1,y2,…,yTf\}\.Y=\\\{y\_\{1\},y\_\{2\},\.\.\.,y\_\{T\_\{f\}\}\\\}\.\(10\)We construct a neighborhood centered at each ground\-truth valueyty\_\{t\}:

𝒩r​\(yt\)=\[yt−r,yt\+r\],\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)=\[y\_\{t\}\-r,\\,y\_\{t\}\+r\],\(11\)whererris a hyperparameter\.\{𝒩r​\(yt\)\}t=1Tf\\\{\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)\\\}\_\{t=1\}^\{T\_\{f\}\}constitute the ground\-truth neighborhood𝒩r​\(Y\)\\mathcal\{N\}\_\{r\}\(Y\)\.

Secondly, we introduce how to compute the first regularization term, namely the neighborhood probability mass constraint\. Specifically, letpθ,t​\(z∣𝒞ti\)p\_\{\\theta,t\}\(z\\mid\\mathcal\{C\}\_\{t\}^\{i\}\)denote the probability density atzzof the predictive distribution at thett\-th future time point of theii\-th sampled trajectory\. For one\-shot forecasting,𝒞ti=X\\mathcal\{C\}\_\{t\}^\{i\}=X; for token\-by\-token forecasting,𝒞ti\\mathcal\{C\}\_\{t\}^\{i\}additionally includes the previously generated segments\. Next, we compute the probability mass assigned to the neighborhood𝒩r​\(yt\)\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)under the context of theii\-th trajectory:

pi​\(𝒩r​\(yt\)\)=∫yt−ryt\+rpθ,t​\(z∣𝒞ti\)​𝑑z\.p^\{i\}\(\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)\)=\\int\_\{y\_\{t\}\-r\}^\{y\_\{t\}\+r\}p\_\{\\theta,t\}\(z\\mid\\mathcal\{C\}\_\{t\}^\{i\}\)\\,dz\.\(12\)The integral in Eq\.[12](https://arxiv.org/html/2608.08010#Sx6.E12)can be computed using Gauss–Legendre quadrature\(Swarztrauber[2003](https://arxiv.org/html/2608.08010#bib.bib162)\)\. Based on this, we define the neighborhood probability mass constraint for theii\-th sampled trajectory as the mean log\-probability ofpi​\(𝒩r​\(yt\)\)p^\{i\}\(\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)\)over all future time points:

ℒmassi=1Tf​∑t=1Tflog⁡\(pi​\(𝒩r​\(yt\)\)\)\\displaystyle\\mathcal\{L\}\_\{\\mathrm\{mass\}\}^\{i\}=\\frac\{1\}\{T\_\{f\}\}\\sum\_\{t=1\}^\{T\_\{f\}\}\\log\\\!\\left\(p^\{i\}\\\!\\left\(\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)\\right\)\\right\)\(13\)The reason for using the logarithm is that it imposes a stronger penalty on forecast points with extremely low probability, preventing them from being overlooked in the constraint\. Our ablation study validates the rationality of this design\.

For token\-by\-token forecasting, different sampled trajectories have different predictive distributions\. We thus average the trajectory\-wise constraints to get the final neighborhood probability mass constraint:ℒmass=1n​∑i=1nℒmassi,\\mathcal\{L\}\_\{\\mathrm\{mass\}\}=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\\mathcal\{L\}\_\{\\mathrm\{mass\}\}^\{i\},wherennis the number of trajectories sampled for each input during one update of the RL algorithm\. For one\-shot forecasting, the predictive distributions depend only onXXand are identical across sampled trajectories\. That makesℒmass1=⋯=ℒmassn\\mathcal\{L\}\_\{\\mathrm\{mass\}\}^\{1\}=\\cdots=\\mathcal\{L\}\_\{\\mathrm\{mass\}\}^\{n\}\. Therefore, we simply setℒmass=ℒmassi\\mathcal\{L\}\_\{\\mathrm\{mass\}\}=\\mathcal\{L\}\_\{\\mathrm\{mass\}\}^\{i\}in this case\. By maximizingℒmass\\mathcal\{L\}\_\{\\mathrm\{mass\}\}, we encourage the model to assign more probability mass to the ground\-truth neighborhoods under different trajectory contexts, thereby increasing the likelihood of sampling high\-quality trajectories near the ground truth\.

Finally, we describe how to compute the second regularization term, namely, the within\-neighborhood uniformity constraint\. Specifically, we first normalize the predictive density of theii\-th sampled trajectory in𝒩r​\(yt\)\\mathcal\{N\}\_\{r\}\(y\_\{t\}\):

p~θ,ti​\(z∣𝒞ti\)=pθ,t​\(z∣𝒞ti\)/pi​\(𝒩r​\(yt\)\),z∈𝒩r​\(yt\)\.\\widetilde\{p\}^\{i\}\_\{\\theta,t\}\(z\\mid\\mathcal\{C\}\_\{t\}^\{i\}\)=p\_\{\\theta,t\}\(z\\mid\\mathcal\{C\}\_\{t\}^\{i\}\)/p^\{i\}\(\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)\),\\quad z\\in\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)\.

\(14\)
Meanwhile, we define the uniform distribution in𝒩r​\(yt\)\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)as:

ut​\(z\)=1/2​r,z∈𝒩r​\(yt\)\.u\_\{t\}\(z\)=1/2r,\\quad z\\in\\mathcal\{N\}\_\{r\}\(y\_\{t\}\)\.\(15\)LetP~θ,ti\\widetilde\{P\}^\{i\}\_\{\\theta,t\}andUtU\_\{t\}denote the distributions corresponding top~θ,ti​\(z∣𝒞t\)\\widetilde\{p\}^\{i\}\_\{\\theta,t\}\(z\\mid\\mathcal\{C\}\_\{t\}\)andut​\(z\)u\_\{t\}\(z\), respectively\. Based on this, we define the within\-neighborhood uniformity constraint for theii\-th sampled trajectory as the negative mean KL divergence between these two distributions over all future time points:

ℒunii=−1Tf​∑t=1TfDKL​\(P~θ,ti∥Ut\)\.\\mathcal\{L\}^\{i\}\_\{\\text\{uni\}\}=\-\\frac\{1\}\{T\_\{f\}\}\\sum\_\{t=1\}^\{T\_\{f\}\}D\_\{\\text\{KL\}\}\\left\(\\widetilde\{P\}^\{i\}\_\{\\theta,t\}\\parallel U\_\{t\}\\right\)\.\(16\)TheDKLD\_\{\\text\{KL\}\}also can be computed using Gauss–Legendre quadrature\(Swarztrauber[2003](https://arxiv.org/html/2608.08010#bib.bib162)\)\. Similar toℒmass\\mathcal\{L\}\_\{\\mathrm\{mass\}\}, for token\-by\-token forecasting,ℒuni\\mathcal\{L\}\_\{\\mathrm\{uni\}\}is defined as the mean ofℒunii\\mathcal\{L\}\_\{\\mathrm\{uni\}\}^\{i\}over all sampled trajectories:ℒuni=1n​∑i=1nℒunii\\mathcal\{L\}\_\{\\mathrm\{uni\}\}=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\\mathcal\{L\}\_\{\\mathrm\{uni\}\}^\{i\}\. For one\-shot forecasting,ℒuni=ℒunii\\mathcal\{L\}\_\{\\mathrm\{uni\}\}=\\mathcal\{L\}\_\{\\mathrm\{uni\}\}^\{i\}\. By maximizingℒuni\\mathcal\{L\}\_\{\\text\{uni\}\}, we encourage a uniform distribution within𝒩r​\(Y\)\\mathcal\{N\}\_\{r\}\(Y\), preventing the probability mass from concentrating on only a few locations and thereby preserving the model’s exploration capability\.

Table 1:Forecasting results averaged from four prediction lengths∈\\in\{96, 192, 336, 720\}\. Most baseline results are from\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223)\); the rest are obtained by running the source code on the datasets\.Table 2:More Forecasting results\. The baseline results derive from TimeRFT\(Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\)\. The percentages in the table indicate the proportion of the training data used\. The experimental setup follows Table 2 in TimeRFT\.Table 3:Zero\-shot results averaged over prediction lengths96,192,336,720\{96,192,336,720\}\.![Refer to caption](https://arxiv.org/html/2608.08010v1/x7.png)\(a\)
![Refer to caption](https://arxiv.org/html/2608.08010v1/x8.png)\(b\)
![Refer to caption](https://arxiv.org/html/2608.08010v1/x9.png)\(c\)

Figure 5:\(a\) Mean ground\-truth\-neighborhood log probability during training\. \(b\) and sampling variance during training\. \(c\) Test\-set forecasting performance\. In \(b\),×101\\times 10^\{1\}indicates that the actual variances of the dataset are 10 times the plotted values\.![Refer to caption](https://arxiv.org/html/2608.08010v1/x10.png)Figure 6:The output distributions for the training samples in Fig\.[1](https://arxiv.org/html/2608.08010#Sx1.F1)after incorporating GTN\-R\. More visualization results are provided in Appendix "More Visualization"\.
### Learning Objective of GTN\-R

After obtaining the neighborhood probability mass constraint and the within\-neighborhood uniformity constraint, we incorporate both into the original RL objective, yielding the GTN\-R learning objective to be maximized:

ℒG​T​N−R=ℒR​L\+λm​ℒm​a​s​s\+λu​ℒu​n​i,\\mathcal\{L\}\_\{GTN\-R\}=\\mathcal\{L\}\_\{RL\}\+\\lambda\_\{m\}\\mathcal\{L\}\_\{mass\}\+\\lambda\_\{u\}\\mathcal\{L\}\_\{uni\},\(17\)where,ℒRL\\mathcal\{L\}\_\{\\text\{RL\}\}denotes the original RL objective, whileλm\\lambda\_\{m\}andλu\\lambda\_\{u\}are the weights of the two regularization terms\. Maximizing this objective enables the model to mitigate suboptimal collapse while preserving its autonomous exploration capability, thereby further improving forecasting performance\.

## Experiments

In this section, we empirically evaluate GTN\-R\. We first introduce the experimental setup, then present comparative results of multiple datasets and visualize how GTN\-R affects the model’s output distributions during training\. Additional visualizations, ablations, computational\-cost, and hyperparameter\-sensitivity are provided in the Appendix\.

### Experimental Settings

Datasets:

For general time series forecasting, we use eight real\-world datasets: ETT \(ETTh1, ETTh2, ETTm1, and ETTm2\), ECL, Weather, Loop Seattle, and ENTSO\-e Load\. For zero\-shot forecasting, we use the ETT and Weather datasets\. The data splits for Loop Seattle and ENTSO\-e Load follow TimeRFT\(Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\), while those for the remaining datasets follow\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223)\)\.

Baselines:

We mainly follow the post\-training evaluation framework of\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223)\)and adopt Moirai\(Wooet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib596)\), Toto\(Cohenet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib132)\), Moirai\-MoE\(Liuet al\.[2024a](https://arxiv.org/html/2608.08010#bib.bib133)\), and UniTS\(Gaoet al\.[2024](https://arxiv.org/html/2608.08010#bib.bib158)\)as the time series foundation models\. Following\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223)\), we use the x128 pretrained checkpoint for UniTS\. Since UniTS supports only deterministic forecasting, when integrated with RL methods, we modify and retrain its output layer to produce predictive distributions; further details are in Appendix "Probabilistic Adaptation of UniTS"\. The compared post\-training methods include full\-parameter supervised fine\-tuning \(Full SFT\), LoRA, MSFT\(Qiaoet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib223)\), TPO\(Qiet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib150)\), TimeRFT\(Liet al\.[2026](https://arxiv.org/html/2608.08010#bib.bib16)\), and our proposed TS\-GRPO\. Implementation details of TS\-GRPO are provided in Appendix "TS\-GRPO"\. TPO is applicable only to TSFMs that adopt the one\-shot forecasting paradigm, whereas TimeRFT is specifically designed for Moirai\-MoE\. Accordingly, we apply TPO only to Moirai and UniTS, and TimeRFT only to Moirai\-MoE\. In contrast, TS\-GRPO can be applied to any TSFM with probabilistic outputs\. Moreover, because TimeRFT involves a complex training pipeline and numerous hyperparameters, we compare against it only on the Loop Seattle and ENTSO\-e Load datasets, for which its training scripts are publicly available\. We do not compare with conventional TSF methods, such as iTransformer\(Liuet al\.[2023](https://arxiv.org/html/2608.08010#bib.bib408)\), PatchTST\(Nieet al\.[2023](https://arxiv.org/html/2608.08010#bib.bib25)\), DLinear\(Zenget al\.[2023](https://arxiv.org/html/2608.08010#bib.bib359)\), TimeMixer\(Wanget al\.[2024](https://arxiv.org/html/2608.08010#bib.bib360)\), and SimpleTM\(Chenet al\.[2025](https://arxiv.org/html/2608.08010#bib.bib361)\), because pretrained TSFMs already achieve comparable performance, making comparisons with post\-trained TSFMs unfair\.

Implementation Details:

All experiments are implemented in PyTorch\(Imambiet al\.[2021](https://arxiv.org/html/2608.08010#bib.bib554)\)on an NVIDIA RTX 4090 GPU\. We use the Adam optimizer\(Kingma and Ba[2014](https://arxiv.org/html/2608.08010#bib.bib69)\)\. The hyperparametersλm\\lambda\_\{m\}andλu\\lambda\_\{u\}are both set to 1\. The neighborhood radiusrris set to 1 for Loop Seattle, 100 for ENTSO\-e Load, and 0\.1 for all other datasets\. These values are selected based on the hyperparameter sensitivity results\. Other settings, including the learning rate and batch size, follow the best configurations of the corresponding post\-training methods\. The maximum number of training epochs is set to 40\. Early stopping is triggered when the validation loss does not decrease for three consecutive evaluation rounds\.

### Forecasting Performance

We evaluate GTN\-R under both standard and zero\-shot forecasting settings\. In the standard setting, we compare our method with other methods, with results reported in Tables[1](https://arxiv.org/html/2608.08010#Sx6.T1)and[2](https://arxiv.org/html/2608.08010#Sx6.T2)\. In the zero\-shot setting, the model is trained on one dataset and evaluated on another, with results shown in Table[3](https://arxiv.org/html/2608.08010#Sx6.T3)\. All results are averaged over five runs with different random seeds\. For each base method, the best post\-training result is highlighted in bold, while the second\-best is underlined\. Overall, incorporating GTN\-R can improve the performance of existing RL post\-training methods\.

### Method Analysis

In this subsection, we further validate the effectiveness of the proposed method by visualizing how the model’s output distribution evolves during training after incorporating GTN\-R\. The experimental setup and the selection of samples for visualization are consistent with those in Fig\.[2b](https://arxiv.org/html/2608.08010#Sx3.F2.sf2)\. During training, we record the following three metrics: 1\) the mean log probability assigned by the model’s output distribution to the ground\-truth neighborhoods of the selected training samples; 2\) the sampling variance of the predictive trajectories for these samples; and 3\) the forecasting performance of the trained model on the test set\. We compare three settings: standard training, directly adding the ground\-truth trajectory to the sampled group, and training with GTN\-R\. The results are presented in Figs\.[5](https://arxiv.org/html/2608.08010#Sx6.F5)\. As shown in Fig\.[5a](https://arxiv.org/html/2608.08010#Sx6.F5.sf1), GTN\-R prevents the ground\-truth\-neighborhood probability mass from decreasing, thereby mitigating suboptimal collapse\. Fig\.[5b](https://arxiv.org/html/2608.08010#Sx6.F5.sf2)further shows that its sampling variance declines much less than in the other two settings, indicating better preservation of the exploration ability\. Consequently, GTN\-R achieves superior test\-set forecasting performance, as shown in Fig\.[5c](https://arxiv.org/html/2608.08010#Sx6.F5.sf3)\.

Furthermore, we visualize the evolution of the predictive distributions for the training samples in Fig\.[1](https://arxiv.org/html/2608.08010#Sx1.F1)after incorporating GTN\-R\. We use the same random seed in the experiments to ensure consistent training dynamics\. The results are in Fig\.[6](https://arxiv.org/html/2608.08010#Sx6.F6)\. Comparing Figs\.[1](https://arxiv.org/html/2608.08010#Sx1.F1)and[6](https://arxiv.org/html/2608.08010#Sx6.F6), we observe that GTN\-R mitigates suboptimal collapse as training progresses\.

## Conclusion

This paper identifies suboptimal collapse in RL post\-training of TSFMs and analyzes its self\-reinforcing mechanism\. To mitigate its negative impact on training, we propose GTN\-R, which increases the probability mass assigned to the ground\-truth neighborhood while maintaining a uniform distribution within it\. This alleviates suboptimal collapse while preserving the model’s exploration capability\. Experiments across multiple models, datasets, and RL methods demonstrate that GTN\-R consistently improves forecasting performance\.

## References

- K\. Abhishek, M\. Singh, S\. Ghosh, and A\. Anand \(2012\)Weather forecasting model using artificial neural network\.Procedia Technology4,pp\. 311–318\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- O\. Boussif, G\. Boukachab, D\. Assouline, S\. Massaroli, T\. Yuan, L\. Benabbou, and Y\. Bengio \(2024\)Improving\* day\-ahead\* solar irradiance time series forecasting by leveraging spatio\-temporal context\.Advances in Neural Information Processing Systems36\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- S\. D\. Campbell and F\. X\. Diebold \(2005\)Weather forecasting for weather derivatives\.Journal of the American Statistical Association100\(469\),pp\. 6–16\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- H\. Chen, V\. Luong, L\. Mukherjee, and V\. Singh \(2025\)SimpleTM: a simple baseline for multivariate time series forecasting\.InThe Thirteenth International Conference on Learning Representations,Cited by:[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- T\. Chu, Y\. Zhai, J\. Yang, S\. Tong, S\. Xie, D\. Schuurmans, Q\. V\. Le, S\. Levine, and Y\. Ma \(2025\)Sft memorizes, rl generalizes: a comparative study of foundation model post\-training\.arXiv preprint arXiv:2501\.17161\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p3.1)\.
- J\. S\. Clark and O\. N\. Bjørnstad \(2004\)Population time series: process variability, observation errors, missing values, lags, and hidden states\.Ecology85\(11\),pp\. 3140–3150\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- B\. Cohen, E\. Khwaja, K\. Wang, C\. Masson, E\. Ramé, Y\. Doubli, and O\. Abou\-Amal \(2024\)Toto: time series optimized transformer for observability\.arXiv preprint arXiv:2407\.07874\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1),[Probabilistic Forecasting and Sampling in TSFMs](https://arxiv.org/html/2608.08010#Sx3.SSx2.p3.4),[Empirical Analysis](https://arxiv.org/html/2608.08010#Sx5.p2.1),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- A\. Das, W\. Kong, R\. Sen, and Y\. Zhou \(2024\)A decoder\-only foundation model for time\-series forecasting\.InForty\-first International Conference on Machine Learning,Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- C\. Deb, F\. Zhang, J\. Yang, S\. E\. Lee, and K\. W\. Shah \(2017\)A review on time series forecasting techniques for building energy consumption\.Renewable and Sustainable Energy Reviews74,pp\. 902–924\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- Y\. Fang, Y\. Qin, H\. Luo, F\. Zhao, and K\. Zheng \(2023\)STWave\+: a multi\-scale efficient spectral graph attention network with long\-term trends for disentangled traffic flow forecasting\.IEEE Transactions on Knowledge and Data Engineering\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- S\. Gao, T\. Koker, O\. Queen, T\. Hartvigsen, T\. Tsiligkaridis, and M\. Zitnik \(2024\)Units: a unified multi\-task time series model\.Advances in Neural Information Processing Systems37,pp\. 140589–140631\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- M\. Goswami, K\. Szafer, A\. Choudhry, Y\. Cai, S\. Li, and A\. Dubrawski \(2024\)Moment: a family of open time\-series foundation models\.arXiv preprint arXiv:2402\.03885\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- L\. C\. Hamilton, C\. Brown, and B\. D\. Keim \(2007\)Ski areas, weather and climate: time series models for new england case studies\.International Journal of Climatology\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- S\. Imambi, K\. B\. Prakash, and G\. Kanagachidambaresan \(2021\)PyTorch\.InProgramming with TensorFlow: solution for edge computing applications,pp\. 87–104\.Cited by:[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p6.3)\.
- Z\. Karevan and J\. A\. Suykens \(2020\)Transductive lstm for time\-series prediction: an application to weather forecasting\.Neural Networks125,pp\. 1–9\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- D\. P\. Kingma and J\. Ba \(2014\)Adam: a method for stochastic optimization\.arXiv preprint arXiv:1412\.6980\.Cited by:[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p6.3)\.
- S\. R\. K\. Kottapalli, K\. Hubli, S\. Chandrashekhara, G\. Jain, S\. Hubli, G\. Botla, and R\. Doddaiah \(2025\)Foundation models for time series: a survey\.arXiv preprint arXiv:2504\.04011\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- P\. Lara\-Benítez, M\. Carranza\-García, J\. M\. Luna\-Romera, and J\. C\. Riquelme \(2020\)Temporal convolutional networks applied to energy\-related time series forecasting\.applied sciences10\(7\),pp\. 2322\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- R\. Li, F\. Zhang, T\. Li, N\. Zhang, and T\. Zhang \(2022\)DMGAN: dynamic multi\-hop graph attention network for traffic forecasting\.IEEE Transactions on Knowledge and Data Engineering\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- S\. Li, Y\. Chen, Z\. Zhu, Y\. Pan, Y\. Guo, M\. Huang, and H\. Xiong \(2026\)TimeRFT: stimulating generalizable time series forecasting for tsfms via reinforcement finetuning\.arXiv preprint arXiv:2605\.00015\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1),[Introduction](https://arxiv.org/html/2608.08010#Sx1.p2.1),[Related Work](https://arxiv.org/html/2608.08010#Sx2.p2.1),[Theoretical Analysis](https://arxiv.org/html/2608.08010#Sx4.p5.3),[Empirical Analysis](https://arxiv.org/html/2608.08010#Sx5.p2.1),[Table 2](https://arxiv.org/html/2608.08010#Sx6.T2),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p2.1),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- X\. Liu, T\. Aksu, J\. Liu, Q\. Wen, Y\. Liang, C\. Xiong, S\. Savarese, D\. Sahoo, J\. Li, and C\. Liu \(2025\)Empowering time series analysis with synthetic data: a survey and outlook in the era of foundation models\.arXiv preprint arXiv:2503\.11411\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- X\. Liu, J\. Liu, G\. Woo, T\. Aksu, Y\. Liang, R\. Zimmermann, C\. Liu, S\. Savarese, C\. Xiong, and D\. Sahoo \(2024a\)Moirai\-moe: empowering time series foundation models with sparse mixture of experts\.arXiv preprint arXiv:2410\.10469\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1),[Probabilistic Forecasting and Sampling in TSFMs](https://arxiv.org/html/2608.08010#Sx3.SSx2.p3.4),[Empirical Analysis](https://arxiv.org/html/2608.08010#Sx5.p2.1),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- Y\. Liu, T\. Hu, H\. Zhang, H\. Wu, S\. Wang, L\. Ma, and M\. Long \(2023\)Itransformer: inverted transformers are effective for time series forecasting\.arXiv preprint arXiv:2310\.06625\.Cited by:[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- Y\. Liu, H\. Zhang, C\. Li, X\. Huang, J\. Wang, and M\. Long \(2024b\)Timer: generative pre\-trained transformers are large time series models\.arXiv preprint arXiv:2402\.02368\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- Z\. Liu, B\. Li, H\. Huang, Y\. Sun, Y\. Wang, M\. Wu, and Q\. Ma \(2026\)From pre\-training to post\-training: a survey on time series foundation models\.Cited by:[Probabilistic Forecasting and Sampling in TSFMs](https://arxiv.org/html/2608.08010#Sx3.SSx2.p1.1)\.
- J\. A\. Miller, M\. Aldosari, F\. Saeed, N\. H\. Barna, S\. Rana, I\. B\. Arpinar, and N\. Liu \(2024\)A survey of deep learning and foundation models for time series forecasting\.arXiv preprint arXiv:2401\.13912\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- Y\. Nie, N\. H\. Nguyen, P\. Sinthong, and J\. Kalagnanam \(2023\)A time series is worth 64 words: long\-term forecasting with transformers\.ICLR\.Cited by:[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- R\. Novo, P\. Marocco, G\. Giorgi, A\. Lanzini, M\. Santarelli, and G\. Mattiazzo \(2022\)Planning the decarbonisation of energy systems: the importance of applying time series clustering to long\-term models\.Energy Conversion and Management: X15,pp\. 100274\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- L\. Ouyang, J\. Wu, X\. Jiang, D\. Almeida, C\. Wainwright, P\. Mishkin, C\. Zhang, S\. Agarwal, K\. Slama, A\. Ray,et al\.\(2022\)Training language models to follow instructions with human feedback\.Advances in neural information processing systems35,pp\. 27730–27744\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p2.1)\.
- Y\. Qi, H\. Hu, D\. Lei, J\. Zhang, Z\. Shi, Y\. Huang, Z\. Chen, X\. Lin, and Z\. M\. Shen \(2025\)Timehf: billion\-scale time series models guided by human feedback\.arXiv preprint arXiv:2501\.15942\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1),[Introduction](https://arxiv.org/html/2608.08010#Sx1.p2.1),[Related Work](https://arxiv.org/html/2608.08010#Sx2.p2.1),[Empirical Analysis](https://arxiv.org/html/2608.08010#Sx5.p2.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.15.13.1.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.16.14.1.2),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.29.27.1.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.30.28.1.2),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.7.5.1.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.8.6.1.2),[Table 3](https://arxiv.org/html/2608.08010#Sx6.T3.4.4.10.5.1.1),[Table 3](https://arxiv.org/html/2608.08010#Sx6.T3.4.4.11.6.1.2),[Table 3](https://arxiv.org/html/2608.08010#Sx6.T3.4.4.18.13.1.1),[Table 3](https://arxiv.org/html/2608.08010#Sx6.T3.4.4.19.14.1.2),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- Z\. Qiao, C\. Liu, Y\. Zhang, M\. Jin, Q\. Pham, Q\. Wen, P\. Suganthan, X\. Jiang, and S\. Ramasamy \(2025\)Multi\-scale finetuning for encoder\-based time series foundation models\.arXiv preprint arXiv:2506\.14087\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1),[Related Work](https://arxiv.org/html/2608.08010#Sx2.p2.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.14.12.1.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.22.20.1.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.28.26.1.1),[Table 1](https://arxiv.org/html/2608.08010#Sx6.T1.3.1.6.4.1.1),[Table 3](https://arxiv.org/html/2608.08010#Sx6.T3.4.4.17.12.1.1),[Table 3](https://arxiv.org/html/2608.08010#Sx6.T3.4.4.9.4.1.1),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p2.1),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- Z\. Shao, P\. Wang, Q\. Zhu, R\. Xu, J\. Song, X\. Bi, H\. Zhang, M\. Zhang, Y\. Li, Y\. Wu,et al\.\(2024\)Deepseekmath: pushing the limits of mathematical reasoning in open language models\.arXiv preprint arXiv:2402\.03300\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p2.1)\.
- S\. Shekhar and B\. M\. Williams \(2007\)Adaptive seasonal time series models for forecasting short\-term traffic flow\.Transportation Research Record2024\(1\),pp\. 116–125\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- P\. N\. Swarztrauber \(2003\)On computing the points and weights for gauss–legendre quadrature\.SIAM Journal on Scientific Computing24\(3\),pp\. 945–954\.Cited by:[Ground\-Truth Neighborhood Regularization](https://arxiv.org/html/2608.08010#Sx6.SSx2.p3.10),[Ground\-Truth Neighborhood Regularization](https://arxiv.org/html/2608.08010#Sx6.SSx2.p6.14)\.
- H\. Wang, J\. Chen, Z\. Fan, Z\. Zhang, Z\. Cai, and X\. Song \(2022\)St\-expertnet: a deep expert framework for traffic prediction\.IEEE Transactions on Knowledge and Data Engineering\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1)\.
- S\. Wang, H\. Wu, X\. Shi, T\. Hu, H\. Luo, L\. Ma, J\. Y\. Zhang, and J\. Zhou \(2024\)Timemixer: decomposable multiscale mixing for time series forecasting\.arXiv preprint arXiv:2405\.14616\.Cited by:[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- S\. Wang, Y\. Shen, H\. Sun, S\. Feng, S\. Teng, L\. Dong, Y\. Hao, and W\. Chen \(2025\)Benefits and pitfalls of reinforcement learning for language model planning: a theoretical perspective\.arXiv preprint arXiv:2509\.22613\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p3.1)\.
- M\. Weltevrede, F\. Kaubek, M\. T\. Spaan, and W\. Böhmer \(2024\)Explore\-go: leveraging exploration for generalisation in deep reinforcement learning\.arXiv preprint arXiv:2406\.08069\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p3.1)\.
- G\. Woo, C\. Liu, A\. Kumar, C\. Xiong, S\. Savarese, and D\. Sahoo \(2024\)Unified training of universal time series forecasting transformers\.InForty\-first International Conference on Machine Learning,Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p1.1),[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1),[Probabilistic Forecasting and Sampling in TSFMs](https://arxiv.org/html/2608.08010#Sx3.SSx2.p2.1),[Empirical Analysis](https://arxiv.org/html/2608.08010#Sx5.p2.1),[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.
- Y\. Yan, K\. Tang, S\. Chen, K\. Xu, D\. Hu, Q\. Yu, and P\. Hu \(2026\)S\-grpo: unified post\-training for large vision\-language models\.arXiv preprint arXiv:2604\.16557\.Cited by:[Introduction](https://arxiv.org/html/2608.08010#Sx1.p3.1)\.
- J\. Ye, Y\. Yu, W\. Zhang, L\. Wang, J\. Li, and F\. Tsung \(2026\)Empowering time series analysis with foundation models: a comprehensive survey\.Information Fusion,pp\. 104601\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- T\. Yoon, Y\. Park, E\. K\. Ryu, and Y\. Wang \(2022\)Robust probabilistic time series forecasting\.InInternational Conference on Artificial Intelligence and Statistics,pp\. 1336–1358\.Cited by:[Related Work](https://arxiv.org/html/2608.08010#Sx2.p1.1)\.
- A\. Zeng, M\. Chen, L\. Zhang, and Q\. Xu \(2023\)Are transformers effective for time series forecasting?\.AAAI\.Cited by:[Experimental Settings](https://arxiv.org/html/2608.08010#Sx7.SSx1.p4.1)\.

Similar Articles