DST-Net: Decomposed Spatio-Temporal Network for Time Series Forecasting
Summary
DST-Net 提出一种解耦的时空网络用于时间序列预测,针对趋势和季节分量分别设计潜在图块和高斯多尺度注意力机制,以匹配各分量的内在特性并在多个基准上验证有效。
View Cached Full Text
Cached at: 10/16/26, 06:57 AM
# DST-Net: Decomposed Spatio-Temporal Network for Time Series Forecasting
Source: [https://arxiv.org/html/2610.21123](https://arxiv.org/html/2610.21123)
###### Abstract
Series decomposition has emerged as a widely acknowledged paradigm in deep time series forecasting models\. However, existing approaches predominantly employ a homogeneous modeling strategy for all subsequences, thereby overlooking the distinct inductive biases inherent in different components\. We identify that the trend component exhibits dominant spatial coupling across channels but carries significant temporal redundancy, whereas the seasonal component is characterized by local temporal evolution but remains susceptible to attention distraction\. To address this, we propose a novel disentangled architecture that tailors specific modeling strategies to align with the intrinsic properties of each component\. For the trend branch, we design a Latent Graph Block, employing latent graph modeling to capture global topological dependencies and system\-wide co\-movements\. Conversely, for the seasonal branch, we introduce a Gaussian Multi\-scale Attention mechanism to mitigate attention distraction\. By injecting learnable Gaussian priors, we impose structural constraints that compel the model to focus on multi\-granular local contexts, effectively filtering out global noise and accurately capturing local evolutionary phases\. Extensive experiments on multiple real\-world benchmarks demonstrate the effectiveness of our proposed model\.
###### Keywords:
Time series forecasting Time series decomposition Spatio\-temporal modeling Latent graph learning
## 1Introduction
Time series forecasting plays a pivotal role in numerous real\-world applications, such as weather forecasting\[[2](https://arxiv.org/html/2610.21123#bib.bib1),[8](https://arxiv.org/html/2610.21123#bib.bib2)\]and economic analysis\[[7](https://arxiv.org/html/2610.21123#bib.bib5),[13](https://arxiv.org/html/2610.21123#bib.bib6)\]\. However, real\-world time series data typically exhibit extreme complexity characterized by the entanglement of non\-stationarity and multi\-scale variations\. To tackle these intricate temporal patterns, the research community primarily relies on designing various sophisticated deep learning architectures, such as models based on Transformers\[[19](https://arxiv.org/html/2610.21123#bib.bib14),[25](https://arxiv.org/html/2610.21123#bib.bib22),[11](https://arxiv.org/html/2610.21123#bib.bib7),[21](https://arxiv.org/html/2610.21123#bib.bib25)\]or MLPs\[[6](https://arxiv.org/html/2610.21123#bib.bib12),[20](https://arxiv.org/html/2610.21123#bib.bib9),[17](https://arxiv.org/html/2610.21123#bib.bib10)\], which aim to capture latent complex relationships within sequences through powerful representation learning capabilities\.
To alleviate modeling difficulty and decouple complex temporal variations, series decomposition has become a widely acknowledged paradigm in deep forecasting models\. Since Autoformer\[[19](https://arxiv.org/html/2610.21123#bib.bib14)\]introduced decomposition as a fundamental block into deep networks, dismantling the original sequence into more predictable seasonal and trend components has proven effective\. Subsequent studies, such as TimeMixer\[[17](https://arxiv.org/html/2610.21123#bib.bib10)\], have further augmented the expressive power of decomposition architectures by utilizing multi\-scale mixing techniques\. Nevertheless, while existing methods have introduced numerous innovations regarding decomposition or fusion strategies, they frequently overlook the importance of differentiating the modeling of decomposed subsequences\. Most existing methods employ identical network architectures \(e\.g\., the same attention mechanism\) to extract features from both high\-frequency seasonal and low\-frequency trend components\. We argue that this uniform modeling approach fails to adequately account for the distinct properties of the decomposed components, thereby limiting the representation capability of the model\.
Figure 1:Statistical visualization of the decomposed components in Traffic dataset\. \(a\) The trend component exhibits significant spatial co\-movement and correlation among variates\. \(b\) The seasonal component displays clear temporal periodicity and autocorrelation\.In this study, we delve into the intrinsic properties of the decomposed components and identify that seasonal and trend patterns exhibit distinct inductive biases\. As illustrated in Fig\.[1](https://arxiv.org/html/2610.21123#S1.F1)\(a\-1\), distinct variables exhibit synchronized trend behavior, which is often determined by the underlying global state of the system, leading to strong coupling effects among variables\. For instance, the onset of daily traffic peak hours acts as a latent global state that simultaneously drives up traffic occupancy rates across numerous upstream and downstream sensors, causing a synchronized rise in congestion levels throughout the entire network\. This observation is quantitatively supported by the spatial correlation matrix in Fig\.[1](https://arxiv.org/html/2610.21123#S1.F1)\(a\-2\) where the dominance of high correlation values indicates that variables are deeply intertwined\. Therefore, relying solely on temporal information is insufficient for trend modeling and necessitates the introduction of spatial dependency among variables to capture such system\-level synergetic changes\.
Conversely, the seasonal component is temporal\-dominant and characterized by high\-frequency fluctuations and periodic patterns\. As illustrated in Fig\.[1](https://arxiv.org/html/2610.21123#S1.F1)\(b\-1\), the evolution of the seasonal component exhibits distinct local continuity and periodicity, where the current state is strictly constrained by its immediate historical context and the evolutionary slope of the waveform\. To further substantiate the temporal dependence of the seasonal component, we employed the Autocorrelation Function \(ACF\) analysis as shown in Fig\.[1](https://arxiv.org/html/2610.21123#S1.F1)\(b\-2\)\. This plot was generated by calculating the correlation coefficients between the seasonal time series and its own lagged versions at various time steps\. The results display significant positive peaks at periodic intervals \(specifically at Lag 24\), which quantitatively confirm that the seasonal component possesses strong self\-correlation properties\. This evidence reinforces the observation that the seasonal pattern is primarily driven by temporal self\-evolution rather than external spatial factors, thereby justifying the focus on temporal modeling for the seasonal component\.
Based on the aforementioned analysis, we propose a novel disentangled architecture that tailors distinct modeling strategies for the trend and seasonal components to align with their respective inductive biases\. For the trend branch, we design a Latent Graph Block, employing latent graph modeling to capture global topological dependencies and system\-wide co\-movements\. Conversely, for the seasonal branch, to address the distraction issue arising from distant numerical similarities, we introduce a Gaussian Multi\-scale Attention mechanism\. By injecting learnable Gaussian priors into the attention heads, we enforce a structural constraint that compels the model to focus on multi\-granular local contexts, ranging from narrow views targeting high\-frequency jitters to wider views capturing local periodic patterns\. This design effectively filters out global noise and ensures the model captures the precise local evolution and phase shifts inherent in seasonal data\. Finally, the temporal representations modeled independently in each branch are fused to yield the final predicted sequence\. Extensive experiments on downstream datasets demonstrate the effectiveness of our proposed model\.
## 2Related Work
### 2\.1Deep Time Series Forecasting Paradigms
With the progressive breakthroughs in deep learning, the landscape of time series forecasting has evolved from RNN\- and CNN\-based models\[[16](https://arxiv.org/html/2610.21123#bib.bib4),[1](https://arxiv.org/html/2610.21123#bib.bib3)\]to sophisticated Transformer variants\. Early Transformer\-based methods, such as Informer\[[25](https://arxiv.org/html/2610.21123#bib.bib22)\]and Autoformer\[[19](https://arxiv.org/html/2610.21123#bib.bib14)\], adopted a Channel Mixing strategy, projecting multivariate features into a unified embedding space to capture latent correlations\. However, as noted in recent studies\[[12](https://arxiv.org/html/2610.21123#bib.bib21),[10](https://arxiv.org/html/2610.21123#bib.bib24)\], this strategy often results in overfitting due to the entanglement of noise and signals, leading to inferior performance compared to simple linear baselines \(e\.g\., DLinear\[[20](https://arxiv.org/html/2610.21123#bib.bib9)\]\)\. Consequently, the paradigm shifted towards Channel Independence \(CI\), represented by PatchTST\[[15](https://arxiv.org/html/2610.21123#bib.bib8)\]and TiDE\[[4](https://arxiv.org/html/2610.21123#bib.bib13)\], which treats each variate independently and shares weights across channels\. While CI significantly enhances robustness and data efficiency, it inherently sacrifices the capability to model cross\-variable dependencies, creating a bottleneck in scenarios where system\-wide coupling is critical\. Hybrid approaches\[[11](https://arxiv.org/html/2610.21123#bib.bib7),[24](https://arxiv.org/html/2610.21123#bib.bib20)\]have attempted to revive Channel Dependence \(CD\) by renovating attention mechanisms to capture cross\-variate interactions explicitly\. Recent Mamba\-based\[[5](https://arxiv.org/html/2610.21123#bib.bib16),[22](https://arxiv.org/html/2610.21123#bib.bib17),[23](https://arxiv.org/html/2610.21123#bib.bib18)\]forecasters adapt selective state\-space models to capture temporal and cross\-variate dependencies\. MambaTS\[[3](https://arxiv.org/html/2610.21123#bib.bib19)\]learns inter\-variable dependencies to determine variable\-aware scan orders, while TimePro\[[14](https://arxiv.org/html/2610.21123#bib.bib26)\]constructs variable\- and time\-aware hyper\-states to preserve fine\-grained temporal information during cross\-variate modeling\. Overall, these methods primarily model temporal and channel dependencies within a unified framework for the sequence as a whole, whereas DST\-Net tailors its modeling strategies to the distinct characteristics of decomposed components to better capture temporal dynamics and cross\-variate dependencies\.
## 3Methodology
### 3\.1Problem Definition and Overall Architecture
Problem Definition\.Let𝐗=\{𝐱1,…,𝐱L\}∈ℝL×N\\mathbf\{X\}=\\\{\\mathbf\{x\}\_\{1\},\\dots,\\mathbf\{x\}\_\{L\}\\\}\\in\\mathbb\{R\}^\{L\\times N\}denote the historical observed sequence, whereLLis the lookback window size andNNis the number of variates\. The objective of multivariate time series forecasting is to predict the future sequence𝐘=\{𝐱L\+1,…,𝐱L\+T\}∈ℝT×N\\mathbf\{Y\}=\\\{\\mathbf\{x\}\_\{L\+1\},\\dots,\\mathbf\{x\}\_\{L\+T\}\\\}\\in\\mathbb\{R\}^\{T\\times N\}, whereTTis the forecasting horizon\. The core challenge lies in disentangling the complex, coupled spatiotemporal dependencies hidden within the non\-stationary observations to achieve accurate predictions\.
Overall Pipeline\.To effectively disentangle the conflicting inductive biases inherent in time series components, we propose theDecomposedSpatio\-TemporalNetwork \(DST\-Net\)\. The overall pipeline is illustrated in Fig\.[2](https://arxiv.org/html/2610.21123#S3.F2)\(a\)\.
Figure 2:Overview of DST\-Net\. \(a\) Overall architecture\. \(b\) Gaussian Multi\-scale Attention \(GMA\)\.To decouple the complex temporal variations, we employ a standard series decomposition block\. Following widely adopted practices\[[19](https://arxiv.org/html/2610.21123#bib.bib14)\], we utilize a moving average filter with kernel sizeκ\\kappato extract the trend component\. The seasonal component is then derived by subtracting the trend from the original series:
𝐗t=AvgPool\(𝐗,κ\),𝐗s=𝐗−𝐗t,\\mathbf\{X\}\_\{t\}=\\text\{AvgPool\}\(\\mathbf\{X\},\\kappa\),\\quad\\mathbf\{X\}\_\{s\}=\\mathbf\{X\}\-\\mathbf\{X\}\_\{t\},\(1\)where𝐗t,𝐗s∈ℝL×N\\mathbf\{X\}\_\{t\},\\mathbf\{X\}\_\{s\}\\in\\mathbb\{R\}^\{L\\times N\}represent the trend and seasonal components, respectively\.
Unlike previous methods that employ homogeneous networks for all components, DST\-Net processes the decomposed series through two parallel branches tailored to their specific inductive biases\. For theTrend Branch \(Spatial Domain\), recognizing that the trend component represents the macroscopic system state characterized by temporal redundancy but strong spatial coupling, we introduce the Latent Graph Block\. This branch compresses𝐗t\\mathbf\{X\}\_\{t\}into a low\-dimensional latent space to eliminate temporal redundancy, explicitly models global topological dependencies to capture system\-wide co\-movements, and subsequently reconstructs the future trend𝐘^t\\hat\{\\mathbf\{Y\}\}\_\{t\}\. Simultaneously, theSeasonal Branch \(Temporal Domain\)addresses the seasonal component driven by local continuity\. We design the Gaussian Multi\-scale Attention to inject Gaussian priors, enforcing the model to focus on multi\-granular local contexts\. This mechanism effectively filters out global noise and distractions, leading to an accurate forecast of the future seasonality𝐘^s\\hat\{\\mathbf\{Y\}\}\_\{s\}\.
Finally, the predictions from both branches are aggregated to form the normalized forecast\.
𝐘^=𝐘^t\+𝐘^s\.\\hat\{\\mathbf\{Y\}\}=\\hat\{\\mathbf\{Y\}\}\_\{t\}\+\\hat\{\\mathbf\{Y\}\}\_\{s\}\.\(2\)
This disentangled pipeline ensures that each component is modeled with its optimal inductive bias, leading to superior representation capability and forecasting accuracy\.
### 3\.2Seasonal Branch: Gaussian Multi\-scale Attention
#### Motivation
The seasonal component𝐗s\\mathbf\{X\}\_\{s\}is characterized by high\-frequency fluctuations and recurring periodic patterns\. Vanilla Transformers, which rely on a global receptive field and point\-wise dot\-product similarity, are limited for modeling such data\. The limitation stems from the mismatch betweennumerical similarityandstate similarity\. In periodic sequences, temporally distant yet numerically similar points predominantly occupy distinct phases \(e\.g\., rising vs\. falling edges\); however, vanilla attention assigns excessive weights to these points, resulting in the phenomenon of Attention Distraction\. As visualized in Fig\.[3](https://arxiv.org/html/2610.21123#S3.F3)\(a\), this manifests as a scattered, checkerboard\-like attention map\. This global noise causes the model to over\-smooth representations by aggregating irrelevant historical information, thereby losing the ability to distinguish subtle local variations and phase transitions\.
Figure 3:Visualization of Different Attention Maps\.To resolve this ambiguity, we argue thattemporal localityis the critical inductive bias for seasonal modeling\. The physical state of a seasonal point is defined not just by its value, but by its local continuity and trend, which can be inferred exclusively from its immediate context\. As demonstrated in Fig\.[3](https://arxiv.org/html/2610.21123#S3.F3)\(b\) and \(c\), enforcing a local focus, either narrow for high\-frequency jitter or wide for local context, effectively filters out these distant distractions and enables the model to accurately capture the continuous evolution of the waveform\.
#### Gaussian Multi\-scale Attention
Based on the insight that local context provides an important cue for distinguishing temporal phases, we propose theGaussian Multi\-scale Attention \(GMA\)\. Instead of utilizing a hard\-coded local window or allowing unconstrained global search, we inject learnable Gaussian priors into the attention mechanism to modulate the receptive field adaptively\.
Formally, given the query𝐐\\mathbf\{Q\}, key𝐊\\mathbf\{K\}, and value𝐕\\mathbf\{V\}matrices, the standard attention scoreSi,jS\_\{i,j\}between queryiiand keyjjis computed as a scaled dot\-product\. In GMA, we introduce a distance\-based Gaussian biasGi,jG\_\{i,j\}to the score:
Attention\(𝐐,𝐊,𝐕\)=Softmax\(𝐐𝐊⊤dk\+𝐆\)𝐕,\\text\{Attention\}\(\\mathbf\{Q\},\\mathbf\{K\},\\mathbf\{V\}\)=\\text\{Softmax\}\\left\(\\frac\{\\mathbf\{Q\}\\mathbf\{K\}^\{\\top\}\}\{\\sqrt\{d\_\{k\}\}\}\+\\mathbf\{G\}\\right\)\\mathbf\{V\},\(3\)where the Gaussian bias𝐆∈ℝL×L\\mathbf\{G\}\\in\\mathbb\{R\}^\{L\\times L\}is defined based on the temporal distance\|i−j\|\|i\-j\|:
Gi,j=−\(i−j\)22σ2\+ϵ\.G\_\{i,j\}=\-\\frac\{\(i\-j\)^\{2\}\}\{2\\sigma^\{2\}\+\\epsilon\}\.\(4\)Here,σ\\sigmais a learnable parameter that controls the bandwidth \(i\.e\., the effective receptive field\) of the attention head, andϵ\\epsilonis a small constant for numerical stability\. This additive bias enforces a soft locality constraint: whenσ\\sigmais small,Gi,jG\_\{i,j\}decays rapidly as the distance increases, forcing the attention to focus on immediate neighbors; whenσ\\sigmais large, the mechanism approximates global attention\.
To capture temporal patterns at various scales simultaneously, we adopt a multi\-head splitting strategy as illustrated in Fig\.[2](https://arxiv.org/html/2610.21123#S3.F2)\(b\)\. Specifically, we partition theHHattention heads into four distinct groups, each initialized with a specific bandwidthσ\\sigmato target a unique temporal granularity\. TheNarrow View\(σ≈0\.5\\sigma\\approx 0\.5\) restricts the receptive field to the immediate vicinity, focusing on high\-frequency jitters and derivatives to determine instantaneous trends\. TheMedium View\(σ≈1\.0\\sigma\\approx 1\.0\) captures local substructures and short\-term continuity, while theWide View\(σ≈5\.0\\sigma\\approx 5\.0\) expands the focus to encompass meaningful local periodic contexts, such as significant portions of a cycle\. Finally, to ensure the model retains the capacity for long\-range dependency modeling, we allocate aGlobal View\(σ→∞\\sigma\\to\\infty\) that operates without Gaussian constraints\. By explicitly assigning these distinct roles, this mechanism effectively suppresses distractions across multiple scales\.
### 3\.3Trend Branch: Latent Graph Block
Trend trajectories evolve smoothly and may co\-vary across variates\. TheLatent Graph Block \(LGB\)summarizes each variate’s history as a latent node and applies sparse cross\-variate attention to capture these dependencies\.
Given𝐗t∈ℝL×N\\mathbf\{X\}\_\{t\}\\in\\mathbb\{R\}^\{L\\times N\}, the node representations are obtained through a shared linear projection:
𝐙\(0\)=ϕin\(𝐗t⊤\)∈ℝN×d,\\mathbf\{Z\}^\{\(0\)\}=\\phi\_\{\\mathrm\{in\}\}\(\\mathbf\{X\}\_\{t\}^\{\\top\}\)\\in\\mathbb\{R\}^\{N\\times d\},\(5\)whereϕin:ℝL→ℝd\\phi\_\{\\mathrm\{in\}\}:\\mathbb\{R\}^\{L\}\\rightarrow\\mathbb\{R\}^\{d\}\. For each headh=1,…,Hgh=1,\\ldots,H\_\{g\}, learned linear projections mapLN\(𝐙\(0\)\)\\operatorname\{LN\}\(\\mathbf\{Z\}^\{\(0\)\}\)to𝐐\(h\),𝐊\(h\),𝐕\(h\)∈ℝN×dh\\mathbf\{Q\}^\{\(h\)\},\\mathbf\{K\}^\{\(h\)\},\\mathbf\{V\}^\{\(h\)\}\\in\\mathbb\{R\}^\{N\\times d\_\{h\}\}\. Neighboring features are aggregated using Top\-KKattention:
𝐌\(h\)=Softmax\(ℳK\(𝐐\(h\)\(𝐊\(h\)\)⊤dh\)\)𝐕\(h\),\\mathbf\{M\}^\{\(h\)\}=\\operatorname\{Softmax\}\\left\(\\mathcal\{M\}\_\{K\}\\left\(\\frac\{\\mathbf\{Q\}^\{\(h\)\}\(\\mathbf\{K\}^\{\(h\)\}\)^\{\\top\}\}\{\\sqrt\{d\_\{h\}\}\}\\right\)\\right\)\\mathbf\{V\}^\{\(h\)\},\(6\)whereℳK\\mathcal\{M\}\_\{K\}retains theKKlargest scores in each row and sets the remaining entries to−∞\-\\inftybefore row\-wise softmax\.
The head outputs are concatenated and projected back todddimensions through a residual update:
𝐙a=𝐙\(0\)\+ϕout\(Concat\[𝐌\(1\),…,𝐌\(Hg\)\]\)\.\\mathbf\{Z\}\_\{a\}=\\mathbf\{Z\}^\{\(0\)\}\+\\phi\_\{\\mathrm\{out\}\}\\left\(\\operatorname\{Concat\}\[\\mathbf\{M\}^\{\(1\)\},\\ldots,\\mathbf\{M\}^\{\(H\_\{g\}\)\}\]\\right\)\.\(7\)A feed\-forward block with residual connections and layer normalization produces𝐙t∈ℝN×d\\mathbf\{Z\}\_\{t\}\\in\\mathbb\{R\}^\{N\\times d\}\. A shared prediction headϕpred:ℝd→ℝT\\phi\_\{\\mathrm\{pred\}\}:\\mathbb\{R\}^\{d\}\\rightarrow\\mathbb\{R\}^\{T\}then yields𝐘^t=ϕpred\(𝐙t\)⊤∈ℝT×N\\hat\{\\mathbf\{Y\}\}\_\{t\}=\\phi\_\{\\mathrm\{pred\}\}\(\\mathbf\{Z\}\_\{t\}\)^\{\\top\}\\in\\mathbb\{R\}^\{T\\times N\}\.
## 4Experiments
### 4\.1Experimental Setup
We evaluate DST\-Net on both long\-term and short\-term forecasting tasks\. Long\-term experiments use seven benchmarks: ETTh1, ETTh2, ETTm1, ETTm2, Exchange, Traffic, and Weather, with prediction horizons of 96, 192, 336, and 720\. Short\-term experiments use PEMS04 with an input length of 96 and a prediction horizon of 12\. Data preprocessing and training, validation, and test splits follow previous studies\[[15](https://arxiv.org/html/2610.21123#bib.bib8),[11](https://arxiv.org/html/2610.21123#bib.bib7)\]\.
We compare DST\-Net with representative models, including TimeMixer\[[17](https://arxiv.org/html/2610.21123#bib.bib10)\], iTransformer\[[11](https://arxiv.org/html/2610.21123#bib.bib7)\], and PatchTST\[[15](https://arxiv.org/html/2610.21123#bib.bib8)\], covering multi\-scale, variate\-wise, and patch\-based modeling\. DST\-Net is implemented in PyTorch, and all experiments run on a single NVIDIA H20 GPU with 144 GB of memory\. All methods use identical data splits and preprocessing\. Unless otherwise specified, the unified configurations follow TimeMixer\[[17](https://arxiv.org/html/2610.21123#bib.bib10)\]\.
### 4\.2Evaluation Metrics
For long\-term time series forecasting, we employ Mean Squared Error \(MSE\) and Mean Absolute Error \(MAE\) as the evaluation metrics\. For short\-term forecasting, following the standard settings of previous studies, we adopt MAE, Root Mean Squared Error \(RMSE\), and Mean Absolute Percentage Error \(MAPE\)\. Lower values indicate better forecasting performance for all evaluation metrics\.
### 4\.3Long\-term Forecasting
Table[1](https://arxiv.org/html/2610.21123#S4.T1)shows that DST\-Net achieves leading average performance on most benchmarks and consistently ranks among the strongest methods across prediction horizons\. Its competitive MSE and MAE at both shorter and longer horizons indicate that the gains persist across the evaluated forecasting ranges\.
Table 1:Long\-term forecasting results\. We average the results across 4 prediction lengths:\{96,192,336,720\}\\\{96,192,336,720\\\}\. The best performance is highlighted inred, and the second\-best isunderlined\.On Exchange and Traffic, DST\-Net leads in both average metrics, which is consistent with its emphasis on cross\-variate trend dependencies\. It also remains competitive on the ETT series and Weather, suggesting that the model handles diverse temporal patterns\. TimeMixer retains an advantage on ETTm2, illustrating that the relative benefits vary across datasets\.
Overall, these results suggest that adapting the modeling strategy to each decomposed component is beneficial for long\-term forecasting\. The Latent Graph Block targets cross\-variate trend dependencies, while Gaussian Multi\-scale Attention models seasonal evolution at multiple temporal scales\. The following ablation studies further examine how these two branches contribute to the observed gains\.
### 4\.4Short\-term Forecasting
We evaluate DST\-Net on PEMS04 for short\-term traffic forecasting, using 96 historical observations to predict the next 12 time steps\. As shown in Table[2](https://arxiv.org/html/2610.21123#S4.T2), DST\-Net achieves the lowest MAPE, RMSE, and MAE among the compared methods\.
Compared with the reproduced TimeMixer baseline, DST\-Net reduces MAPE, RMSE, and MAE by 12\.5%, 2\.5%, and 1\.0%, respectively\. The larger gain in MAPE indicates that the improvement is particularly evident in errors measured relative to ground\-truth traffic flow, alongside reductions in absolute forecasting errors\.
These results support the effectiveness of component\-specific modeling for short\-term forecasting\. In PEMS04, traffic states across sensors are influenced by shared road conditions, making cross\-sensor dependencies relevant to prediction\. The Latent Graph Block dynamically aggregates information from relevant sensors to model correlated trend variations, while Gaussian Multi\-scale Attention models local fluctuations and recurring temporal patterns at different granularities\. Their complementary roles allow DST\-Net to capture both cross\-sensor co\-movements and short\-term temporal dynamics, consistent with its effectiveness in both long\-term and short\-term forecasting\.
Table 2:Short\-term forecasting results on the PEMS04 dataset\. All input lengths are 96 and prediction lengths are 12\. The results of TimeMixer are reproduced under the same experimental setting for a fair comparison\.
### 4\.5Effectiveness of Different Components
Table 3:Component ablation results of DST\-Net on Exchange, ETTh1, and Weather in terms of MSE\.To evaluate the contribution of each component, we construct three variants of DST\-Net:w/o Decbypasses series decomposition,w/o LGremoves Latent Graph Block from the trend branch, andw/o GMAreplaces Gaussian Multi\-scale Attention with vanilla self\-attention\. As shown in Table[3](https://arxiv.org/html/2610.21123#S4.T3), removing decomposition consistently increases the average MSE, demonstrating the importance of separating heterogeneous temporal components\. Removing the Latent Graph Block causes the largest degradation on Exchange, increasing the average MSE from 0\.339 to 0\.368, which verifies its effectiveness in capturing cross\-variate trend dependencies\. In contrast, removing Gaussian Multi\-scale Attention has the greatest effect on Weather, where the average MSE increases from 0\.239 to 0\.263\. This confirms the benefit of Gaussian locality constraints for modeling complex seasonal variations\. Overall, the results demonstrate the complementary contributions of decomposition, latent graph modeling, and Gaussian multi\-scale temporal modeling\.
### 4\.6Effectiveness of Component\-specific Modeling
Table 4:Effectiveness of component\-specific modelingTo verify whether the branch assignment is essential, we compare DST\-Net with three alternative designs:Both GMA, which applies GMA to both components;Both LG, which applies LG to both components; andSwapped, which exchanges the modeling strategies of the seasonal and trend branches\. As shown in Table[4](https://arxiv.org/html/2610.21123#S4.T4), both homogeneous variants underperform the complete model, indicating that applying an identical modeling strategy overlooks the distinct properties of the decomposed components\. Moreover,Swappedproduces the largest degradation, increasing the average MSE from 0\.339/0\.418/0\.239 to 0\.367/0\.443/0\.267 on Exchange, ETTh1, and Weather, respectively\. These results confirm that the performance gain arises not only from the individual modules, but also from assigning GMA to seasonal evolution and LG to cross\-variate trend modeling\.
### 4\.7Effectiveness of Different Gaussian Scales in GMA
Table 5:Impact of different Gaussian scales in GMA on the Weather dataset\.To evaluate the impact of the design of our Gaussian Multi\-scale Attention \(GMA\) mechanism, we conduct a detailed analysis on the Weather dataset by varying the combination of Gaussian scales\. As shown in Table[5](https://arxiv.org/html/2610.21123#S4.T5), while single\-scale variants such as the Narrow or Medium capture specific temporal granularities, they yield suboptimal results\. Our full multi\-scale configuration, which fuses Narrow, Medium, Wide, and Global perspectives, achieves the superior MSE of 0\.239\. This improvement validates that the seasonal component’s features are best captured through a hierarchical focus, where learnable Gaussian priors across multiple scales allow the model to simultaneously filter high\-frequency noise and retain long\-term periodic dependencies, thereby ensuring a more robust representation of complex seasonal patterns\.
### 4\.8Qualitative Analysis: Component Disentanglement
Figure 4:Disentanglement analysis on the Traffic dataset\. We compare the ground truth \(GT\) decomposition with the predictions of our trend branch \(Y^t\\hat\{Y\}\_\{t\}\), seasonal branch \(Y^s\\hat\{Y\}\_\{s\}\), and full sequence\.Figure[4](https://arxiv.org/html/2610.21123#S4.F4)illustrates the complementary behavior of the two forecasting branches\. The trend prediction follows the smooth evolution of the decomposed target, while the seasonal prediction captures the recurring oscillatory structure\. Nevertheless, the seasonal branch underestimates the isolated abrupt peak, indicating that rare high\-amplitude events remain challenging\. The reconstructed sequence follows the overall temporal pattern, suggesting that the two branches provide complementary information for forecasting\.
## 5Conclusion
In this paper, we propose DST\-Net, a novel decomposed spatio\-temporal network designed to address the inherent inductive bias conflicts between seasonal and trend components in time series forecasting\. By identifying that the trend component is dominated by global spatial coupling while the seasonal component relies on local temporal evolution, we move beyond traditional homogeneous modeling strategies\. Our architecture integrates a Latent Graph Block to capture system\-wide co\-movements within the trend branch and a Gaussian Multi\-scale Attention mechanism to mitigate attention distraction in the seasonal branch\. Extensive experiments on real\-world benchmarks demonstrate that DST\-Net consistently outperforms leading models in both long\-term and short\-term forecasting tasks\.
## 6Acknowledgments
This work is supported in part by the Key Research Project of Pengcheng Laboratory under Grant PCL2025A14\.
## References
- \[1\]S\. Bai\(2018\)An empirical evaluation of generic convolutional and recurrent networks for sequence modeling\.arXiv preprint arXiv:1803\.01271\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[2\]K\. Bi, L\. Xie, H\. Zhang, X\. Chen, X\. Gu, and Q\. Tian\(2023\)Accurate medium\-range global weather forecasting with 3d neural networks\.Nature619\(7970\),pp\. 533–538\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1)\.
- \[3\]X\. Cai, X\. Wang, Y\. Zhu, and Y\. Yao\(2026\)MambaTS: improved selective state space models for long\-term time series forecasting\.Pattern Recognition,pp\. 114536\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[4\]A\. Das, W\. Kong, A\. Leach, S\. Mathur, R\. Sen, and R\. Yu\(2023\)Long\-term forecasting with tide: time\-series dense encoder\.arXiv preprint arXiv:2304\.08424\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.6.1.1)\.
- \[5\]A\. Gu and T\. Dao\(2023\)Mamba: linear\-time sequence modeling with selective state spaces\.arXiv preprint arXiv:2312\.00752\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[6\]Y\. Hu, P\. Liu, P\. Zhu, D\. Cheng, and T\. Dai\(2025\)Adaptive multi\-scale decomposition framework for time series forecasting\.InProceedings of the AAAI conference on artificial intelligence,Vol\.39,pp\. 17359–17367\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1)\.
- \[7\]H\. Huang, M\. Chen, and X\. Qiao\(2024\)Generative learning for financial time series with irregular and scale\-invariant patterns\.InProceedings of International Conference on Learning Representations \(ICLR\),Vienna, Austria,pp\. 01–10\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1)\.
- \[8\]R\. Lam, A\. Sanchez\-Gonzalez, M\. Willson, P\. Wirnsberger, M\. Fortunato, F\. Alet, S\. Ravuri, T\. Ewalds, Z\. Eaton\-Rosen, W\. Hu,et al\.\(2023\)Learning skillful medium\-range global weather forecasting\.Science382\(6677\),pp\. 1416–1421\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1)\.
- \[9\]M\. Liu, A\. Zeng, M\. Chen, Z\. Xu, Q\. Lai, L\. Ma, and Q\. Xu\(2022\)Scinet: time series modeling and forecasting with sample convolution and interaction\.InProceedings of Advances in Neural Information Processing Systems \(NeurIPS\),Vol\.35,New Orleans, USA,pp\. 5816–5828\.Cited by:[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.9.1.1)\.
- \[10\]S\. Liu, H\. Yu, C\. Liao, J\. Li, W\. Lin, A\. X\. Liu, and S\. Dustdar\(2022\)Pyraformer: low\-complexity pyramidal attention for long\-range time series modeling and forecasting\.InProceedings of International Conference on Learning Representations \(ICLR\),Online\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[11\]Y\. Liu, T\. Hu, H\. Zhang, H\. Wu, S\. Wang, L\. Ma, and M\. Long\(2024\)Itransformer: inverted transformers are effective for time series forecasting\.InProceedings of International Conference on Learning Representations \(ICLR\),Vienna, Austria,pp\. 01–10\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1),[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1),[§4\.1](https://arxiv.org/html/2610.21123#S4.SS1.p1.1),[§4\.1](https://arxiv.org/html/2610.21123#S4.SS1.p2.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.3.1.1)\.
- \[12\]Y\. Liu, H\. Wu, J\. Wang, and M\. Long\(2022\)Non\-stationary transformers: exploring the stationarity in time series forecasting\.InProceedings of Advances in Neural Information Processing Systems \(NeurIPS\),Vol\.35,New Orleans, USA,pp\. 9881–9893\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.11.1.1)\.
- \[13\]Y\. Liu, C\. Song, P\. Liu, N\. Li, T\. Dai, J\. Bao, Y\. Jiang, and S\. Xia\(2025\)Mera: mixture of experts with retrieval\-augmented representation for modeling diversified stock patterns\.InCompanion Proceedings of the ACM on Web Conference 2025,pp\. 1148–1152\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1)\.
- \[14\]X\. Ma, Z\. Ni, S\. Xiao, and X\. Chen\(2025\)TimePro: efficient multivariate long\-term time series forecasting with variable\- and time\-aware hyper\-state\.InForty\-second International Conference on Machine Learning,External Links:[Link](https://openreview.net/forum?id=s69Ei2VrIW)Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[15\]Y\. Nie, N\. H\. Nguyen, P\. Sinthong, and J\. Kalagnanam\(2022\)A time series is worth 64 words: long\-term forecasting with transformers\.arXiv preprint arXiv:2211\.14730\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1),[§4\.1](https://arxiv.org/html/2610.21123#S4.SS1.p1.1),[§4\.1](https://arxiv.org/html/2610.21123#S4.SS1.p2.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.4.1.1)\.
- \[16\]D\. Salinas, V\. Flunkert, J\. Gasthaus, and T\. Januschowski\(2020\)DeepAR: probabilistic forecasting with autoregressive recurrent networks\.International journal of forecasting36\(3\),pp\. 1181–1191\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[17\]S\. Wang, H\. Wu, X\. Shi, T\. Hu, H\. Luo, L\. Ma, J\. Y\. Zhang, and J\. Zhou\(2024\)Timemixer: decomposable multiscale mixing for time series forecasting\.InProceedings of International Conference on Learning Representations \(ICLR\),Vienna, Austria,pp\. 01–10\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1),[§1](https://arxiv.org/html/2610.21123#S1.p2.1),[§4\.1](https://arxiv.org/html/2610.21123#S4.SS1.p2.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.2.1.1)\.
- \[18\]H\. Wu, T\. Hu, Y\. Liu, H\. Zhou, J\. Wang, and M\. Long\(2023\)Timesnet: temporal 2d\-variation modeling for general time series analysis\.InProceedings of International Conference on Learning Representations \(ICLR\),Kigali, Rwanda,pp\. 01–10\.Cited by:[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.7.1.1)\.
- \[19\]H\. Wu, J\. Xu, J\. Wang, and M\. Long\(2021\)Autoformer: decomposition transformers with auto\-correlation for long\-term series forecasting\.InProceedings of Advances in Neural Information Processing Systems \(NeurIPS\),Vol\.34,Online,pp\. 22419–22430\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1),[§1](https://arxiv.org/html/2610.21123#S1.p2.1),[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1),[§3\.1](https://arxiv.org/html/2610.21123#S3.SS1.p3.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.12.1.1)\.
- \[20\]A\. Zeng, M\. Chen, L\. Zhang, and Q\. Xu\(2023\)Are transformers effective for time series forecasting?\.InProceedings of the AAAI Conference on Artificial Intelligence \(AAAI\),Vol\.37,Washington, D\.C\., USA,pp\. 11121–11128\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1),[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.8.1.1)\.
- \[21\]Y\. Zha, C\. Fan, P\. Liu, Y\. Jiang, T\. Dai, H\. Wu, and S\. Xia\(2026\)CP loss: channel\-wise perceptual loss for time series forecasting\.InICASSP 2026\-2026 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 3631–3635\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1)\.
- \[22\]Y\. Zha, N\. Li, Y\. Wang, T\. Dai, H\. Guo, B\. Chen, Z\. Wang, Z\. Ouyang, and S\. Xia\(2024\)Lcm: locally constrained compact point cloud model for masked point modeling\.Advances in neural information processing systems37,pp\. 104816–104842\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[23\]Y\. Zha, Y\. Wang, H\. Guo, J\. Wang, T\. Dai, B\. Chen, Z\. Ouyang, X\. Yuerong, K\. Chen, and S\. Xia\(2025\)Pma: towards parameter\-efficient point cloud understanding via point mamba adapter\.In2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 16976–16986\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[24\]Y\. Zhang and J\. Yan\(2023\)Crossformer: transformer utilizing cross\-dimension dependency for multivariate time series forecasting\.InProceedings of International Conference on Learning Representations \(ICLR\),Kigali, Rwanda,pp\. 01–10\.Cited by:[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1),[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.5.1.1)\.
- \[25\]H\. Zhou, S\. Zhang, J\. Peng, S\. Zhang, J\. Li, H\. Xiong, and W\. Zhang\(2021\)Informer: beyond efficient transformer for long sequence time\-series forecasting\.InProceedings of the AAAI Conference on Artificial Intelligence \(AAAI\),Vol\.35,Online,pp\. 11106–11115\.Cited by:[§1](https://arxiv.org/html/2610.21123#S1.p1.1),[§2\.1](https://arxiv.org/html/2610.21123#S2.SS1.p1.1)\.
- \[26\]T\. Zhou, Z\. Ma, Q\. Wen, X\. Wang, L\. Sun, and R\. Jin\(2022\)Fedformer: frequency enhanced decomposed transformer for long\-term series forecasting\.InInternational conference on machine learning,pp\. 27268–27286\.Cited by:[Table 1](https://arxiv.org/html/2610.21123#S4.T1.5.1.2.10.1.1)\.Similar Articles
Nested Spatio-Temporal Time Series Forecasting
This paper proposes a nested spatiotemporal forecasting framework that uses spectral clustering to construct semantically coherent macro-level regions, which provide top-down guidance for fine-grained micro-level predictions. Experiments on high-dimensional datasets show consistent improvements over state-of-the-art baselines.
DSTFView: Multi-View Cloud-Edge Workload Forecasting with Dual-Input Spatio-Temporal-Frequency Modeling
DSTFView is a dual-input spatio-temporal-frequency multi-view framework for cloud-edge workload forecasting, jointly modeling closeness and period dependencies with an adaptive fusion mechanism to capture abrupt changes.
PatchSTG: Scalable Spatiotemporal Graph Transformers for Traffic Forecasting on Irregular Sensor Networks
PatchSTG introduces a patch-based spatiotemporal graph Transformer for traffic forecasting on irregular sensor networks, achieving near-linear complexity while maintaining competitive performance.
Just for FUNS: LLM-Guided Spatio-Temporal Graph Node Generation for Forecasting Unobserved Node States
提出GenST框架,利用微调后的大语言模型从节点描述中提取语义特征,结合时空VAE与生成式Transformer(GenT),在零样本条件下预测传感器网络中未观测节点的未来状态,显著优于现有基线。
STCFormer: Adaptive Spatio-Temporal Modeling with Dynamic Cluster Transformer for Station-based Weather Forecasting
The paper introduces STCFormer, an adaptive spatio-temporal Transformer that dynamically clusters weather stations per temporal patch using a Cluster-Guided Attention Block combining local intra-cluster attention with global regional summaries, achieving the lowest 24-hour MSE across all eight temperature and wind forecasting tasks.