A Dynamic Fusion Large Language Model for Traffic Flow Prediction

arXiv cs.LG Papers

Summary

The paper proposes a Dynamic Fusion Large Language Model (DF-LLM) for traffic flow prediction, integrating spatiotemporal embedding, fusion modules, and an LLM backbone with adaptation strategies to enhance performance over traditional methods in intelligent transportation systems.

arXiv:2609.11314v1 Announce Type: new Abstract: Traffic flow prediction is a core supporting technology for intelligent transportation systems. It uses historical data to infer future traffic dynamics in specific areas, thereby helping to alleviate congestion and improve resource allocation efficiency. Traditional neural networks struggle to break through accuracy limits due to their reliance on singular feature modeling, while large language models (LLMs) suffer from insufficient capture of spatial topological information and mining spatiotemporal correlation. This study proposes a Dynamic Fusion Large Language Model (DF-LLM) for traffic flow prediction. The model incorporates three core components: spatiotemporal embedding module, spatiotemporal fusion module, and LLM backbone. The spatiotemporal embedding module enables synergistic representation of multi-scale spatiotemporal features. The spatiotemporal fusion module integrates spatial topology and dynamic dependencies via graph convolution. The LLM backbone adopts a differentiated parameter adaptation strategy to balance training efficiency and traffic data adaptability. Additionally, it introduces a context aggregation attention module to strengthens global dependencies. More importantly, the LLM backbone takes the residual connections to mitigate the gradient vanishing in deep networks. Experiments show that DF-LLM has achieved better performance by comparing the metrics on all the four datasets.
Original Article
View Cached Full Text

Cached at: 09/11/26, 08:34 AM

# A Dynamic Fusion Large Language Model for Traffic Flow Prediction
Source: [https://arxiv.org/html/2609.11314](https://arxiv.org/html/2609.11314)
Xue Qiu[https://orcid.org/0009-0006-6143-7558](https://orcid.org/0009-0006-6143-7558)Affiliation:School of Optical\-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, China ,E\-mail[233370847@st\.usst\.edu\.cn](mailto:[email protected])Jianli Xiao\(✉\)[https://orcid.org/0000-0002-7363-0623](https://orcid.org/0000-0002-7363-0623)E\-mail[audyxiao@sjtu\.edu\.cn](mailto:[email protected])Affiliation:School of Optical\-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, China ,E\-mail[233370847@st\.usst\.edu\.cn](mailto:[email protected])

###### Abstract

Traffic flow prediction is a core supporting technology for intelligent transportation systems\. It uses historical data to infer future traffic dynamics in specific areas, thereby helping to alleviate congestion and improve resource allocation efficiency\. Traditional neural networks struggle to break through accuracy limits due to their reliance on singular feature modeling, while large language models \(LLMs\) suffer from insufficient capture of spatial topological information and mining spatiotemporal correlation\. This study proposes a Dynamic Fusion Large Language Model \(DF\-LLM\) for traffic flow prediction\. The model incorporates three core components: spatiotemporal embedding module, spatiotemporal fusion module, and LLM backbone\. The spatiotemporal embedding module enables synergistic representation of multi\-scale spatiotemporal features\. The spatiotemporal fusion module integrates spatial topology and dynamic dependencies via graph convolution\. The LLM backbone adopts a differentiated parameter adaptation strategy to balance training efficiency and traffic data adaptability\. Additionally, it introduces a context aggregation attention module to strengthens global dependencies\. More importantly, the LLM backbone takes the residual connections to mitigate the gradient vanishing in deep networks\. Experiments show that DF\-LLM has achieved better performance by comparing the metrics on all the four datasets\.

###### Keywords:

Traffic Flow Prediction Intelligent Transportation Systems Large Language Models Spatiotemporal Features Dynamic Fusion

## 1Introduction

Within intelligent transportation systems \(ITS\), traffic flow prediction plays a pivotal role, enabling accurate forecasting of future traffic conditions based on historical data\. This capability is essential for advancing traffic management, alleviating congestion, and optimizing resource allocation\[[8](https://arxiv.org/html/2609.11314#bib.bib1),[7](https://arxiv.org/html/2609.11314#bib.bib2)\]\.

While traditional time series models like ARIMA and Kalman Filtering can capture linear temporal trends, they struggle to model the complex spatiotemporal dependencies in traffic data\. Convolutional neural networks \(CNNs\) and recurrent neural networks \(RNNs\) have been widely used to capture spatial and temporal dependencies\[[17](https://arxiv.org/html/2609.11314#bib.bib3)\]\. Nevertheless, these models are fundamentally constrained by the irregular, non\-Euclidean topology of traffic data and its multi\-scale periodic patterns\. Graph convolutional networks \(GCNs\)\[[1](https://arxiv.org/html/2609.11314#bib.bib4),[15](https://arxiv.org/html/2609.11314#bib.bib5),[16](https://arxiv.org/html/2609.11314#bib.bib6),[9](https://arxiv.org/html/2609.11314#bib.bib7)\]have been introduced to explicitly address spatial structure in traffic networks, but they often suffer from over\-smoothing, limiting their ability to capture global patterns\. Attention\-based models offer more flexibility but come with complex architectures and substantial computational overhead\.

LLMs have achieved significant progress across multiple domains and are gradually being utilized in time series research\. By leveraging extensive pretraining and massive parameter capacities, LLMs maintain structural stability while enhancing performance\[[3](https://arxiv.org/html/2609.11314#bib.bib8)\]\. However, LLM\-based approaches mainly focus on the temporal dimension, largely neglecting the rich spatial topology in traffic networks\[[2](https://arxiv.org/html/2609.11314#bib.bib9),[18](https://arxiv.org/html/2609.11314#bib.bib10)\]\. Additionally, the structural and semantic disparities between language and traffic data hinder LLMs from effectively transferring knowledge, potentially compromising prediction performance\.

To address these challenges, we propose DF\-LLM, a unified spatiotemporal forecasting framework that integrates graph\-based spatial modeling with a pretrained Transformer backbone for traffic flow prediction\. The proposed framework incorporates a spatiotemporal fusion module with residual connections and a differentiated parameter adaptation strategy, enabling effective domain adaptation while preserving valuable pretrained knowledge\. Extensive experiments demonstrate that DF\-LLM achieves competitive or superior forecasting performance compared with existing advanced methods, highlighting its potential for intelligent transportation systems\.

## 2Proposed Model

As illustrated in Fig\.[1](https://arxiv.org/html/2609.11314#S2.F1), the DF\-LLM framework is designed to process historical traffic data𝐗∈ℝL×M×D\\mathbf\{X\}\\in\\mathbb\{R\}^\{L\\times M\\times D\}as input\. The spatiotemporal embedding module generates multi\-scale embeddings, including initial, temporal, and spatial feature representations\. The spatiotemporal fusion module integrates these embeddings, incorporates residual connections, and leverages a two\-layer GCN to model spatial topological relationships, projecting the fused features to dimensionℝL×M×D′\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}\. The LLM Backbone integrates positional embedding, Transformer blocks, and a context aggregation multi\-head attention \(Context Aggregation MHA\) module to capture long\-range temporal dependencies, adopting a differentiated parameter adaptation strategy that implements partial parameter freezing\. Finally, the traffic prediction module outputs the forecasted traffic flow𝐘^∈ℝL′×M×D\\widehat\{\\mathbf\{Y\}\}\\in\\mathbb\{R\}^\{L^\{\\prime\}\\times M\\times D\}via regression convolution to align with the ground truth𝐘∈ℝL′×M×D\\mathbf\{Y\}\\in\\mathbb\{R\}^\{L^\{\\prime\}\\times M\\times D\}for loss calculation\.

![Refer to caption](https://arxiv.org/html/2609.11314v1/fig1.png)Figure 1:The framework of DF\-LLM\.### 2\.1Spatiotemporal Embedding Module

The spatiotemporal embedding module, which is critical for extracting discriminative representations from historical traffic data, is composed of three parallel branches: initial feature embedding, temporal embedding, and spatial embedding\.

Initial Feature Embedding\.We first employ a pointwise convolution to the input data to extract basic features:

𝐄I=Conv1×1​\(𝐗L,θconv\)\\mathbf\{E\}\_\{I\}=\\text\{Conv\}\_\{1\\times 1\}\(\\mathbf\{X\}\_\{L\};\\theta\_\{\\text\{conv\}\}\)\(1\)
whereConv1×1\\text\{Conv\}\_\{1\\times 1\}denotes a1×11\\times 1convolution operation with kernel shape\[1,1,D,D′\]\[1,1,D,D^\{\\prime\}\], andθconv\\theta\_\{\\text\{conv\}\}represents learnable parameters\. This step generates an initial feature embedding𝐄I∈ℝL×M×D′\\mathbf\{E\}\_\{I\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}\.

Temporal Embedding\.To capture periodic patterns inherent in traffic data, we introduce two learnable parameter matrices:𝐖d\\mathbf\{W\}\_\{d\}and𝐖w\\mathbf\{W\}\_\{w\}\. We extract daily and weekly temporal indicesxdx\_\{d\}andxwx\_\{w\}from the input data, then adopt absolute positional encoding to generate𝐗d∈ℝL×M×Td\\mathbf\{X\}\_\{d\}\\in\\mathbb\{R\}^\{L\\times M\\times T\_\{d\}\}\(daily resolution\) and𝐗w∈ℝL×M×Tw\\mathbf\{X\}\_\{w\}\\in\\mathbb\{R\}^\{L\\times M\\times T\_\{w\}\}\(weekly resolution\), whereTdT\_\{d\}andTwT\_\{w\}denote the number of time steps per day and per week, respectively\. The temporal embedding𝐄T∈ℝL×M×D′\\mathbf\{E\}\_\{T\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}is computed as:

𝐄T=𝐖d⋅𝐗d\+𝐖w⋅𝐗w\\mathbf\{E\}\_\{T\}=\\mathbf\{W\}\_\{d\}\\cdot\\mathbf\{X\}\_\{d\}\+\\mathbf\{W\}\_\{w\}\\cdot\\mathbf\{X\}\_\{w\}\(2\)
Spatial Embedding\.To model spatial topological correlations between road segments, we propose an adaptive spatial embedding mechanism:

𝐄S=ℰ⁡\(WS⋅𝐗L\+bS\)\\mathbf\{E\}\_\{S\}=\\mathcal\{E\}\(W\_\{S\}\\cdot\\mathbf\{X\}\_\{L\}\+b\_\{S\}\)\(3\)
Here,ℰ\\mathcal\{E\}denotes a non\-linear activation function, and the parametersWS∈ℝD×D′W\_\{S\}\\in\\mathbb\{R\}^\{D\\times D^\{\\prime\}\}andbS∈ℝD′b\_\{S\}\\in\\mathbb\{R\}^\{D^\{\\prime\}\}are learnable\. This operation yields a spatial embedding𝐄S∈ℝL×M×D′\\mathbf\{E\}\_\{S\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}that captures spatial topological dependencies\.

The three embeddings𝐄I,𝐄T,\\mathbf\{E\}\_\{I\},\\mathbf\{E\}\_\{T\},and𝐄S\\mathbf\{E\}\_\{S\}are concatenated and fed into the subsequent spatiotemporal fusion module to achieve multi\-scale spatiotemporal feature integration\.

### 2\.2Spatiotemporal Fusion Module

This module integrates and refines the embeddings generated by the spatiotemporal embedding module, and captures spatial topological relationships via dynamic graph convolutional operations\.

Feature Fusion\.By concatenating𝐄I,𝐄T,\\mathbf\{E\}\_\{I\},\\mathbf\{E\}\_\{T\},and𝐄S\\mathbf\{E\}\_\{S\}along the feature dimension, we obtain𝐄concat∈ℝL×M×3​D′\\mathbf\{E\}\_\{\\text\{concat\}\}\\in\\mathbb\{R\}^\{L\\times M\\times 3D^\{\\prime\}\}\. Subsequently, a1×11\\times 1convolution layer with residual connections projects this concatenated feature to the target dimension:

𝐄fused=Conv1×1​\(𝐄concat,θfuse\)\+𝐄res\\mathbf\{E\}\_\{\\text\{fused\}\}=\\text\{Conv\}\_\{1\\times 1\}\(\\mathbf\{E\}\_\{\\text\{concat\}\};\\theta\_\{\\text\{fuse\}\}\)\+\\mathbf\{E\}\_\{\\text\{res\}\}\(4\)
whereθfuse\\theta\_\{\\text\{fuse\}\}denotes learnable parameters of the1×11\\times 1convolution kernel with a shape of\[1,1,3​D′,D′\]\[1,1,3D^\{\\prime\},D^\{\\prime\}\], and𝐄res∈ℝL×M×D′\\mathbf\{E\}\_\{\\text\{res\}\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}is a linear projection of𝐄concat\\mathbf\{E\}\_\{\\text\{concat\}\}to match the output dimension of the1×11\\times 1convolution layer\. Through residual connections, dimensionality reduction from3​D′3D^\{\\prime\}toD′D^\{\\prime\}is achieved while preserving essential spatiotemporal features, mitigating the gradient vanishing problem and enhancing the stability of the training process\.

Spatial Topological Modeling with Graph Convolutional Network\.A two\-layer GCN with residual connections is employed to𝐄fused\\mathbf\{E\}\_\{\\text\{fused\}\}to capture spatial topological dependencies\. Given an adjacency matrix𝐀∈ℝM×M\\mathbf\{A\}\\in\\mathbb\{R\}^\{M\\times M\}that characterizes the inherent connectivity of road segments, the GCN operations are defined as:

𝐄att=Softmax​\(ReLU​\(GCN​\(ReLU​\(GCN​\(𝐄fused,𝐀,θgcn1\)\),𝐀,θgcn2\)\)\)\\mathbf\{E\}\_\{\\text\{att\}\}=\\text\{Softmax\}\\left\(\\text\{ReLU\}\\left\(\\text\{GCN\}\\left\(\\text\{ReLU\}\\left\(\\text\{GCN\}\(\\mathbf\{E\}\_\{\\text\{fused\}\},\\mathbf\{A\};\\theta\_\{\\text\{gcn1\}\}\)\\right\),\\mathbf\{A\};\\theta\_\{\\text\{gcn2\}\}\\right\)\\right\)\\right\)\(5\)𝐄sft=𝐄att\+𝐄fused\\mathbf\{E\}\_\{\\text\{sft\}\}=\\mathbf\{E\}\_\{\\text\{att\}\}\+\\mathbf\{E\}\_\{\\text\{fused\}\}\(6\)
whereθgcn1\\theta\_\{\\text\{gcn1\}\}andθgcn2\\theta\_\{\\text\{gcn2\}\}denote learnable parameters of the two GCN layers, and the GCN operations are applied along the spatial dimension\. This operation aggregates feature information from neighboring nodes based on spatial topological correlations, while the residual connection retains direct access to the original fused features\. The output𝐄sft∈ℝL×M×D′\\mathbf\{E\}\_\{\\text\{sft\}\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}encapsulates rich multi\-scale spatiotemporal information, serving as the input to the LLM Backbone\.

### 2\.3LLM Backbone

In this study, GPT\-2 is adopted as the LLM backbone for traffic flow prediction through selective parameter adaptation and architectural refinement\. Its autoregressive Transformer architecture enables effective temporal dependency modeling while maintaining computational efficiency\.

Differentiated Parameter Adaptation\.As shown in Fig\.[1](https://arxiv.org/html/2609.11314#S2.F1), theKKTransformer blocks of GPT\-2 are divided into two subsets with different parameter update strategies\. For the firstUUblocks, the multi\-head self\-attention \(MHA\) and feed\-forward \(FF\) layers are frozen to preserve pretrained knowledge, while layer normalization \(LN\) layers are trainable to adapt to traffic data distributions\. For the remaining\(K−U\)\(K\-U\)blocks, MHA layers are unfrozen to capture traffic spatiotemporal dependencies, whereas FF layers remain frozen to reduce overfitting\. The input and output of GPT\-2 are denoted as𝐄sft∈ℝL×M×D′\\mathbf\{E\}\_\{\\text\{sft\}\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}and𝐄in∈ℝL×M×D′\\mathbf\{E\}\_\{\\text\{in\}\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}, respectively\.

Context Aggregation MHA Module\.To enhance the adapted GPT\-2 representations, we introduce a Context Aggregation MHA module to aggregate global spatiotemporal information\. By dividing features intohhparallel subspaces, this module captures multi\-scale correlations and integrates residual connections with layer normalization:

𝐄out=Norm​\(𝐄agg\)\+𝐄in\\mathbf\{E\}\_\{\\text\{out\}\}=\\text\{Norm\}\(\\mathbf\{E\}\_\{\\text\{agg\}\}\)\+\\mathbf\{E\}\_\{\\text\{in\}\}\(7\)
where𝐄agg\\mathbf\{E\}\_\{\\text\{agg\}\}denotes the globally aggregated feature\. The resulting representation𝐄LLM\\mathbf\{E\}\_\{\\text\{LLM\}\}combines pretrained knowledge with traffic\-specific spatiotemporal patterns\.

Traffic Flow Prediction\.The generated representation𝐄LLM∈ℝL×M×D′\\mathbf\{E\}\_\{\\text\{LLM\}\}\\in\\mathbb\{R\}^\{L\\times M\\times D^\{\\prime\}\}is fed into a regression convolution layer to predict future traffic flows:

𝐘^L′=RConv​\(𝐄LLM,θr​c\)\\widehat\{\\mathbf\{Y\}\}\_\{L^\{\\prime\}\}=\\text\{RConv\}\(\\mathbf\{E\}\_\{\\text\{LLM\}\};\\theta\_\{rc\}\)\(8\)
where𝐘^∈ℝL′×M×D\\widehat\{\\mathbf\{Y\}\}\\in\\mathbb\{R\}^\{L^\{\\prime\}\\times M\\times D\}represents predictions for the nextL′L^\{\\prime\}time steps andθr​c\\theta\_\{rc\}denotes the learnable parameters\.

## 3Experiments and Results

### 3\.1Experimental Settings

Experiments are conducted on four public traffic datasets: PEMS04, PEMS08, METR\-LA, and PEMS\-BAY\. Each dataset is split into training, validation, and test sets with a ratio of 6:2:2, and both historical and prediction horizons are set to 12 time steps\. DF\-LLM is implemented on the BasicTS\[[13](https://arxiv.org/html/2609.11314#bib.bib12)\]platform and trained on an NVIDIA GeForce RTX 4090 GPU using the Ranger21 optimizer with a learning rate of 0\.0007\. The LLM backbone contains six GPT\-2 layers, with a batch size of 32 and 500 training epochs; early stopping is applied after 30 epochs without validation improvement\. Performance is evaluated using MAE, RMSE, and MAPE, where lower values indicate better accuracy\. DF\-LLM is compared with representative deep learning methods, including DCRNN\[[10](https://arxiv.org/html/2609.11314#bib.bib13)\], STGCN\[[16](https://arxiv.org/html/2609.11314#bib.bib6)\], GWNet\[[15](https://arxiv.org/html/2609.11314#bib.bib5)\], STGODE\[[6](https://arxiv.org/html/2609.11314#bib.bib14)\], STID\[[14](https://arxiv.org/html/2609.11314#bib.bib15)\], AGCRN\[[1](https://arxiv.org/html/2609.11314#bib.bib4)\], STWave\[[5](https://arxiv.org/html/2609.11314#bib.bib16)\], STAEformer\[[12](https://arxiv.org/html/2609.11314#bib.bib17)\], DGCRN\[[9](https://arxiv.org/html/2609.11314#bib.bib7)\], and STNorm\[[4](https://arxiv.org/html/2609.11314#bib.bib18)\], as well as LLM\-based methods such as ST\-LLM\[[11](https://arxiv.org/html/2609.11314#bib.bib11)\]and GCNGPT\[[11](https://arxiv.org/html/2609.11314#bib.bib11)\]\.

Table 1:Evaluation results of DF\-LLM and baseline methods on four datasets\.![Refer to caption](https://arxiv.org/html/2609.11314v1/fig8.png)Figure 2:Comparison of DF\-LLM predictions with ground\-truth values on four datasets: \(a\) PEMS04; \(b\) PEMS08; \(c\) METR\-LA; \(d\) PEMS\-BAY\.
### 3\.2Experimental Results

Main results\.The performance comparisons on PEMS04, PEMS08, METR\-LA, and PEMS\-BAY are summarized in Table[1](https://arxiv.org/html/2609.11314#S3.T1)\. Compared with deep learning and LLM\-based baselines, DF\-LLM achieves competitive forecasting performance across all datasets\. On PEMS04, DF\-LLM obtains 18\.96 \(MAE\), 30\.76 \(RMSE\), and 12\.87% \(MAPE\), outperforming most baselines\. On PEMS08, it achieves 24\.60 \(RMSE\), demonstrating its ability to capture complex spatiotemporal patterns\. For METR\-LA, DF\-LLM achieves 3\.12 \(MAE\), 6\.27 \(RMSE\), and 8\.19% \(MAPE\), surpassing ST\-LLM and GCNGPT\. On PEMS\-BAY, it reaches 1\.63 \(MAE\) and 3\.61 \(RMSE\), highlighting the effectiveness of integrating spatial and temporal information\.

Multi\-scenario adaptability analysis\.To further evaluate the robustness of DF\-LLM under diverse traffic conditions, visualization results are presented in Fig\.[2](https://arxiv.org/html/2609.11314#S3.F2)\. DF\-LLM closely follows the ground truth across different datasets, accurately capturing short\-term fluctuations and periodic patterns in PEMS04 and PEMS08, maintaining stable predictions under congested conditions in METR\-LA, and modeling complex traffic dynamics in the large\-scale PEMS\-BAY dataset\. Combined with the quantitative results in Table[1](https://arxiv.org/html/2609.11314#S3.T1), these results demonstrate that DF\-LLM adapts effectively to diverse traffic patterns and network scales\.

Ablation study\.Table[2](https://arxiv.org/html/2609.11314#S3.T2)presents ablation results evaluating the contributions of Context Aggregation MHA, GCN, and residual connections \(RC\)\. Removing any component leads to performance degradation, while removing residual connections causes the most significant decline\. These results verify the effectiveness of the proposed modules and highlight the importance of residual connections in stabilizing model training\.

Table 2:Ablation study results\.

## 4Conclusion

This paper proposes DF\-LLM, a traffic flow prediction framework that integrates graph convolution with a pretrained LLM backbone for spatiotemporal forecasting\. By incorporating spatiotemporal embedding, graph\-based spatial modeling, Context Aggregation MHA, and differentiated parameter adaptation, DF\-LLM effectively captures complex traffic dynamics\. Experiments on four real\-world datasets demonstrate competitive forecasting performance compared with existing methods, while ablation studies validate the effectiveness of the proposed components\. The model also exhibits stable adaptability across diverse traffic scenarios and network scales, underscoring its potential for intelligent transportation systems\. Future work will explore dynamic spatiotemporal modeling and multimodal traffic data to further improve generalization and adaptability\.

## References

- \[1\]\(2020\)Adaptive graph convolutional recurrent network for traffic forecasting\.Advances in Neural Information Processing Systems33,pp\. 17804–17815\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p2.1),[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[2\]D\. Cao, F\. Jia, S\. O\. Arik, T\. Pfister, Y\. Zheng, W\. Ye, and Y\. Liu\(2024\)TEMPO: prompt\-based generative pre\-trained transformer for time series forecasting\.InThe Twelfth International Conference on Learning Representations,Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p3.1)\.
- \[3\]Y\. Chen, X\. Wang, and G\. Xu\(2023\)GATGPT: a pre\-trained large language model with graph attention network for spatiotemporal imputation\.arXiv preprint arXiv:2311\.14332\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p3.1)\.
- \[4\]J\. Deng, X\. Chen, R\. Jiang, X\. Song, and I\. W\. Tsang\(2021\)ST\-Norm: spatial and temporal normalization for multi\-variate time series forecasting\.InProceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining,pp\. 269–278\.Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[5\]Y\. Fang, Y\. Qin, H\. Luo, F\. Zhao, B\. Xu, L\. Zeng, and C\. Wang\(2023\)When spatio\-temporal meet wavelets: disentangled traffic forecasting via efficient spectral graph attention networks\.In2023 IEEE 39th International Conference on Data Engineering \(ICDE\),pp\. 517–529\.Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[6\]Z\. Fang, Q\. Long, G\. Song, and K\. Xie\(2021\)Spatial\-temporal graph ODE networks for traffic flow forecasting\.InProceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining,pp\. 364–373\.Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[7\]X\. Huang, Y\. Dong, J\. Mao, J\. Liao, Y\. Zhao, and S\. Chen\(2025\)PTE\-DHNet: priority\-aware temporal embedding and dynamic hypergraph network for steel transportation volume prediction\.InInternational Conference on Web Information Systems and Applications,pp\. 15–28\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p1.1)\.
- \[8\]Z\. Lei, Y\. Dong, J\. Li, and C\. Chen\(2025\)ST\-fit: inductive spatial\-temporal forecasting with limited training data\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.39,pp\. 12031–12039\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p1.1)\.
- \[9\]F\. Li, J\. Feng, H\. Yan, G\. Jin, F\. Yang, F\. Sun, D\. Jin, and Y\. Li\(2023\)Dynamic graph convolutional recurrent network for traffic prediction: benchmark and solution\.ACM Transactions on Knowledge Discovery from Data17\(1\),pp\. 1–21\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p2.1),[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[10\]Y\. Li, R\. Yu, C\. Shahabi, and Y\. Liu\(2018\)Diffusion convolutional recurrent neural network: data\-driven traffic forecasting\.InInternational Conference on Learning Representations,Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[11\]C\. Liu, S\. Yang, Q\. Xu, Z\. Li, C\. Long, Z\. Li, and R\. Zhao\(2024\)Spatial\-temporal large language model for traffic prediction\.In2024 25th IEEE International Conference on Mobile Data Management \(MDM\),pp\. 31–40\.Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[12\]H\. Liu, Z\. Dong, R\. Jiang, J\. Deng, J\. Deng, Q\. Chen, and X\. Song\(2023\)Spatio\-temporal adaptive embedding makes vanilla transformer SOTA for traffic forecasting\.InProceedings of the 32nd ACM International Conference on Information and Knowledge Management,pp\. 4125–4129\.Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[13\]Z\. Shao, F\. Wang, Y\. Xu, W\. Wei, C\. Yu, Z\. Zhang, D\. Yao, T\. Sun, G\. Jin, X\. Cao,et al\.\(2025\)Exploring progress in multivariate time series forecasting: comprehensive benchmarking and heterogeneity analysis\.IEEE Transactions on Knowledge and Data Engineering37\(1\),pp\. 291–305\.Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[14\]Z\. Shao, Z\. Zhang, F\. Wang, W\. Wei, and Y\. Xu\(2022\)Spatial\-temporal identity: a simple yet effective baseline for multivariate time series forecasting\.InProceedings of the 31st ACM International Conference on Information & Knowledge Management,pp\. 4454–4458\.Cited by:[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[15\]Z\. Wu, S\. Pan, G\. Long, J\. Jiang, and C\. Zhang\(2019\)Graph wavenet for deep spatial\-temporal graph modeling\.InProceedings of the 28th International Joint Conference on Artificial Intelligence,pp\. 1907–1913\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p2.1),[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[16\]B\. Yu, H\. Yin, and Z\. Zhu\(2018\)Spatio\-temporal graph convolutional networks: a deep learning framework for traffic forecasting\.InProceedings of the 27th International Joint Conference on Artificial Intelligence,pp\. 3634–3640\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p2.1),[§3\.1](https://arxiv.org/html/2609.11314#S3.SS1.p1.1)\.
- \[17\]Z\. Yuan, X\. Zhou, and T\. Yang\(2018\)Hetero\-ConvLSTM: a deep learning approach to traffic accident prediction on heterogeneous spatio\-temporal data\.InProceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining,pp\. 984–992\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p2.1)\.
- \[18\]T\. Zhou, P\. Niu, L\. Sun, R\. Jin,et al\.\(2023\)One fits all: power general time series analysis by pretrained LM\.Advances in Neural Information Processing Systems36,pp\. 43322–43355\.Cited by:[§1](https://arxiv.org/html/2609.11314#S1.p3.1)\.

Similar Articles

Language Modeling with Hyperspherical Flows

arXiv cs.LG

This paper introduces S-FLM, a novel flow-based language model that operates in a hyperspherical latent space to address the computational costs and semantic limitations of existing discrete diffusion and continuous flow models.