SCENARIODIFF: A Scenario-level Guidance Framework for Multimodal Time Series Forecasting--Extended Version
Summary
ScenarioDiff is a hierarchical contextual reasoning framework for multimodal time series forecasting that organizes textual context into three levels to guide a Multimodal Diffusion Transformer, showing effectiveness in event-driven domains.
View Cached Full Text
Cached at: 08/19/26, 10:23 AM
# ScenarioDiff: A Scenario-level Guidance Framework for Multimodal Time Series Forecasting
Source: [https://arxiv.org/html/2608.17164](https://arxiv.org/html/2608.17164)
Tuan\-Binh Tran1, Dat Nguyen\-Cong2, Duc\-Trong Le3, Thanh Trung Huynh1, Tung Kieu4Affiliation:1VinUniversity, Hanoi, Vietnam,2FPT Software AI Center, FPT Corporation, Hanoi, Vietnam, 3VNU University of Engineering and Technology, Hanoi, Vietnam,4Aalborg University, Aalborg, Denmark 1\{binh\.tt2, trung\.ht\}@vinuni\.edu\.vn,2dat27072002@gmail\.com,3trongld@vnu\.edu\.vn4tungkvt@cs\.aau\.dk
###### Abstract
Textual context such as news, reports, and logs can provide valuable signals for time series forecasting, especially when future dynamics are driven by external events that are not yet visible in historical values\. Existing multimodal forecasting methods often either ask large language models \(LLMs\) to predict numerical values directly or fuse text and time series implicitly, making contextual influence difficult to interpret and control\. We proposeScenarioDiff, a hierarchical contextual reasoning framework for multimodal time series forecasting under noisy and weakly aligned documents\.ScenarioDifforganizes contextual information into three levels: a*Historical Context Agent*extracts stepwise evidence from raw documents, a*Scenario Agent*produces a qualitative scenario description for the forecast horizon, and an*Anchor Guidance Agent*generates sparse anchor points for event\-relevant future regions\. These structured signals condition a*Multimodal Diffusion Transformer*, while*Anchor Blended Sampling*locally refines generated trajectories without retraining\. Experiments on theTime\-MMDbenchmark show thatScenarioDiffis especially effective in event\-driven domains, demonstrating the value of explicit hierarchical scenario guidance for multimodal time series forecasting\. Our full implementation is available at[https://anonymous\.4open\.science/r/ScenarioDiff\_ICDM\-2C4C](https://anonymous.4open.science/r/ScenarioDiff_ICDM-2C4C)\.
###### Index Terms:
time series forecasting, multimodal forecasting, diffusion models, large language models, scenario guidance
## IIntroduction
Time series forecasting \(TSF\) supports decision\-making in domains such as energy\[[31](https://arxiv.org/html/2608.17164#bib.bib29)\], economics\[[40](https://arxiv.org/html/2608.17164#bib.bib30)\], healthcare\[[21](https://arxiv.org/html/2608.17164#bib.bib32)\], and transportation\[[8](https://arxiv.org/html/2608.17164#bib.bib31)\]\. Despite its importance, most forecasting models operate primarily on numerical histories\. In practice, however, human experts rarely interpret temporal signals in isolation\. An energy engineer may analyze demand traces together with weather forecasts and maintenance logs, while a financial analyst may read price series alongside earnings reports and macroeconomic news\. Such contextual information can explain historical dynamics and, more importantly, indicate future developments that are not yet visible from numerical values alone\. A motivating example is shown in Figure[1](https://arxiv.org/html/2608.17164#S1.F1), where contextual evidence provides useful clues about future dynamics beyond what is visible from the numerical history alone\.
This observation has motivated growing interest in*multimodal*time series forecasting \(MTSF\), where numerical histories are paired with contextual text such as news, reports, and logs\. Existing studies show that textual information can improve forecasting across domains\[[15](https://arxiv.org/html/2608.17164#bib.bib5),[14](https://arxiv.org/html/2608.17164#bib.bib6),[32](https://arxiv.org/html/2608.17164#bib.bib7),[36](https://arxiv.org/html/2608.17164#bib.bib8)\]\. However, real\-world text is often noisy, redundant, weakly aligned with timestamps, and only partially relevant to the target series\. Under such conditions, implicit text–time fusion makes it difficult to identify which evidence influences the forecast and how strongly the model should trust it\.
Fig\. 1:Motivating example\.Brent crude oil prices around the Israel–Iran conflict in June 2025 illustrate the need for scenario\-level reasoning\. Before the forecast originLL, historical prices show only a moderate upward trend, while available contextual clues indicate rising regional tensions, oil\-supply disruption risk, and geopolitical risk premium\. These signals suggest a near\-term oil\-price shock that is not fully reflected in the numerical history\.ScenarioDiffuses the observed context to form a disruption scenario and produces trajectories that better follow the realized price increase\.Large language models \(LLMs\) are a natural tool for processing unstructured context because they can summarize, filter, and reason over textual evidence\. Recent studies have explored two main directions\. The first direction prompts or reprograms numerical histories into language\-like inputs and asks LLMs to predict future values directly\[[7](https://arxiv.org/html/2608.17164#bib.bib2)\]\. While appealing, this places long\-horizon numerical generation on models primarily optimized for language understanding rather than precise temporal extrapolation\[[41](https://arxiv.org/html/2608.17164#bib.bib4)\]\. The second direction incorporates text through multimodal fusion, cross\-attention, or agent\-based summarization pipelines\[[15](https://arxiv.org/html/2608.17164#bib.bib5),[14](https://arxiv.org/html/2608.17164#bib.bib6),[32](https://arxiv.org/html/2608.17164#bib.bib7),[36](https://arxiv.org/html/2608.17164#bib.bib8)\]\. These methods are effective, but often assume clean text–timestamp alignment or absorb contextual evidence implicitly in latent space\.
An additional challenge is that contextual text may describe not only smooth trend continuation, but also event\-driven deviations such as policy interventions, outages, or abrupt demand shifts\. Capturing such cases requires future\-oriented hypotheses that can guide a numerical forecaster without asking an LLM to directly output numbers\. It also requires a mechanism for translating coarse textual expectations into localized constraints when abrupt changes are likely\.
In this work, we proposeScenarioDiff, a hierarchical contextual reasoning framework for MTSF\. The key idea is to organize contextual information into three complementary levels of guidance, each serving a different role in guiding the forecast\. First, a frozen*Historical Context Agent*compresses raw documents into*stepwise context summaries*aligned with the observed history, grounding the model in document\-level evidence\. Second, a frozen*Scenario Agent*synthesizes the historical series and these summaries into a*scenario description*, which serves as a qualitative prior over the forecast horizon\. Third, an*Anchor Guidance Agent*converts the available context into sparse*anchor points*, providing time\-localized guidance for future regions where abrupt changes are likely\. This hierarchy separates past evidence, future hypotheses, and local trajectory constraints, making contextual influence more explicit and modular than implicit fusion\.
We instantiate the forecaster as a*Multimodal Diffusion Transformer*, which models future trajectories through iterative denoising conditioned on the structured signals produced by the agents\. The stepwise context summaries and scenario description guide the base diffusion process, allowing the model to combine numerical history with scenario\-level textual evidence without asking LLMs to directly output numerical forecasts\. To make anchor points actionable, we introduce*Anchor Blended Sampling*, an inference\-time refinement procedure that locally edits anchor\-relevant regions using a distance\-to\-band objective while preserving non\-anchor regions through blended diffusion\. Thus, anchor points act as soft local constraints rather than hard overrides, encouraging event\-consistent trajectories without retraining the base forecaster\.
We evaluateScenarioDiffon theTime\-MMDbenchmark\[[15](https://arxiv.org/html/2608.17164#bib.bib5)\]\. Results show thatScenarioDiffachieves strong performance, with the clearest gains in event\-driven domains where textual evidence contains actionable signals about future dynamics\. This supports our central hypothesis that explicit hierarchical scenario guidance is most beneficial when future changes are driven by external events weakly reflected in the numerical history\.
In summary, our main contributions are as follows: \(i\) We introduceScenarioDiff, a hierarchical contextual reasoning framework that transforms noisy textual documents into three levels of guidance for MTSF: historical evidence, future scenario, and local anchor constraints\. \(ii\) We integrate these structured signals into a Multimodal Diffusion Transformer, enabling probabilistic forecasting conditioned on explicit historical and scenario\-level context\. \(iii\) We propose Anchor Blended Sampling, which connects anchor points from the Anchor Guidance Agent with local post\-hoc trajectory refinement without retraining the diffusion forecaster\. \(iv\) We provide empirical analysis onTime\-MMD, showing that the main gains concentrate in event\-driven domains where textual evidence carries actionable future signals\.
## IIRelated Work
LLM\-Based Time Series Forecasting\.Recent work has explored large language models \(LLMs\) as sequence priors for time series analysis and forecasting\.OFA\[[45](https://arxiv.org/html/2608.17164#bib.bib3)\]studies how pretrained language\-model backbones can be transferred to time series tasks\.Time\-LLM\[[7](https://arxiv.org/html/2608.17164#bib.bib2)\]reprograms numerical histories into language\-like representations, enabling frozen LLMs to perform few\-shot and zero\-shot forecasting\.CALF\[[17](https://arxiv.org/html/2608.17164#bib.bib1)\]further improves this paradigm by aligning temporal tokens with textual representations\. These methods demonstrate the potential of LLMs to provide semantic priors for forecasting\. However, they often require LLMs to support numerical extrapolation, which is not ideal for precise long\-horizon prediction due to the mismatch between language modeling and fine\-grained temporal generation\. In contrast,ScenarioDiffuses LLMs for producing contextual information rather than direct numerical generation: the agents summarize historical evidence, produce scenario descriptions, and extract anchor points, while a diffusion forecaster handles probabilistic generation\.
Multimodal Time Series Forecasting\.Multimodal time series forecasting incorporates contextual text such as news, reports, logs, and event descriptions into numerical forecasting models\.Time\-MMD\[[15](https://arxiv.org/html/2608.17164#bib.bib5)\]introduces a multi\-domain benchmark and shows that paired textual information can improve forecasting across domains\.TaTS\[[14](https://arxiv.org/html/2608.17164#bib.bib6)\]aligns text with each timestep and uses text embeddings as additional temporal features\.TimeCAP\[[11](https://arxiv.org/html/2608.17164#bib.bib9)\]adopts an agent\-based pipeline to summarize and contextualize time series before prediction, whileChatTime\[[32](https://arxiv.org/html/2608.17164#bib.bib7)\]jointly models numerical and textual inputs in a unifiedTransformer\. Although effective, these approaches often assume clean text–timestamp alignment or fuse text implicitly in latent space, making it difficult to inspect which evidence affects the forecast under noisy, weakly aligned, multi\-document inputs\.ScenarioDiffdiffers by converting raw documents into explicit stepwise context summaries, a scenario description, and anchor points, making the contextual roles more modular and interpretable\.
Diffusion Models for Time Series Forecasting\.Diffusion models have become a strong class of probabilistic forecasters, generating future trajectories through iterative denoising\. Existing methods include one\-shot horizon generation\[[30](https://arxiv.org/html/2608.17164#bib.bib13),[26](https://arxiv.org/html/2608.17164#bib.bib17)\]and autoregressive diffusion\-based prediction\[[23](https://arxiv.org/html/2608.17164#bib.bib12)\]\. Subsequent work improves long\-horizon forecasting with multi\-resolution denoising, structured backbones, and retrieval\-augmented conditioning\[[25](https://arxiv.org/html/2608.17164#bib.bib14),[1](https://arxiv.org/html/2608.17164#bib.bib18),[16](https://arxiv.org/html/2608.17164#bib.bib16)\]\. Recent multimodal diffusion methods further inject timestamps and textual context through fusion, cross\-attention, or classifier\-free guidance\[[28](https://arxiv.org/html/2608.17164#bib.bib11),[39](https://arxiv.org/html/2608.17164#bib.bib15)\], while flow\-matching models aim to reduce sampling cost\[[19](https://arxiv.org/html/2608.17164#bib.bib19),[35](https://arxiv.org/html/2608.17164#bib.bib20)\]\. Most prior methods for condition generation are mainly through architecture\-level fusion and do not explicitly control how external context shapes the sampling\. Our work builds on diffusion forecasting but differs in two aspects\. First, the conditioning signals are not raw text or generic latent embeddings; instead, they are structured scenario\-level signals that separately encode historical evidence and future hypotheses\. Second, beyond architectural conditioning, we introduce an inference\-time guidance mechanism that steers generated trajectories toward sparse anchor bands implied by contextual evidence\. This provides an interpretable and flexible way to shape the forecasting distribution while remaining compatible with standard diffusion backbones\.
## IIIPreliminaries
### III\-ADenoising Diffusion Probabilistic Models
Denoising Diffusion Probabilistic Models \(DDPMs\)\[[6](https://arxiv.org/html/2608.17164#bib.bib10)\]are generative models that iteratively add Gaussian noise to a clean sample,𝐱\(0\)\\mathbf\{x\}^\{\(0\)\}, overTTsteps, following a Markov chain\. The noise schedule,\{βt\}t=1T\\\{\\beta\_\{t\}\\\}\_\{t=1\}^\{T\}, consists ofβt∈\(0,1\)\\beta\_\{t\}\\in\(0,1\), and the cumulative noise is represented byα¯t=∏i=1t\(1−βi\)\\bar\{\\alpha\}\_\{t\}=\\prod\_\{i=1\}^\{t\}\(1\-\\beta\_\{i\}\)\. The forward diffusion process is described by:
q\(𝐱\(1:T\)∣𝐱\(0\)\)\\displaystyle q\(\\mathbf\{x\}^\{\(1:T\)\}\\mid\\mathbf\{x\}^\{\(0\)\}\)=∏t=1Tq\(𝐱\(t\)∣𝐱\(t−1\)\),\\displaystyle=\\prod\_\{t=1\}^\{T\}q\(\\mathbf\{x\}^\{\(t\)\}\\mid\\mathbf\{x\}^\{\(t\-1\)\}\),\(1\)q\(𝐱\(t\)∣𝐱\(t−1\)\)\\displaystyle q\(\\mathbf\{x\}^\{\(t\)\}\\mid\\mathbf\{x\}^\{\(t\-1\)\}\)=𝒩\(1−βt𝐱\(t−1\),βt𝐈\)\.\\displaystyle=\\mathcal\{N\}\\big\(\\sqrt\{1\-\\beta\_\{t\}\}\\,\\mathbf\{x\}^\{\(t\-1\)\},\\beta\_\{t\}\\mathbf\{I\}\\big\)\.\(2\)This process allows us to directly sample𝐱\(t\)\\mathbf\{x\}^\{\(t\)\}from the clean sample𝐱\(0\)\\mathbf\{x\}^\{\(0\)\}as:
𝐱\(t\)=α¯t𝐱\(0\)\+1−α¯tϵ,ϵ∼𝒩\(0,𝐈\)\.\\mathbf\{x\}^\{\(t\)\}=\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}\\,\\mathbf\{x\}^\{\(0\)\}\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\,\\boldsymbol\{\\epsilon\},\\quad\\quad\\boldsymbol\{\\epsilon\}\\sim\\mathcal\{N\}\(0,\\mathbf\{I\}\)\.\(3\)To reverse this diffusion chain, DDPM learns to progressively remove noise in each step\. The reverse process is also modeled as a Markov chain and is defined as:
pθ\(𝐱\(0:T\)\)\\displaystyle p\_\{\\theta\}\(\\mathbf\{x\}^\{\(0:T\)\}\)=pθ\(𝐱\(T\)\)∏t=1Tpθ\(𝐱\(t−1\)∣𝐱\(t\)\),\\displaystyle=p\_\{\\theta\}\(\\mathbf\{x\}^\{\(T\)\}\)\\prod\_\{t=1\}^\{T\}p\_\{\\theta\}\(\\mathbf\{x\}^\{\(t\-1\)\}\\mid\\mathbf\{x\}^\{\(t\)\}\),\(4\)pθ\(𝐱\(t−1\)∣𝐱\(t\)\)\\displaystyle p\_\{\\theta\}\(\\mathbf\{x\}^\{\(t\-1\)\}\\mid\\mathbf\{x\}^\{\(t\)\}\)=𝒩\(μ\(𝐱\(t\),𝐱θ\(𝐱\(t\),t\)\),Σt\)\.\\displaystyle=\\mathcal\{N\}\\big\(\\mu\(\\mathbf\{x\}^\{\(t\)\},\\mathbf\{x\}\_\{\\theta\}\(\\mathbf\{x\}^\{\(t\)\},t\)\),\\Sigma\_\{t\}\\big\)\.\(5\)Here,pθ\(𝐱\(T\)\)p\_\{\\theta\}\(\\mathbf\{x\}^\{\(T\)\}\)is chosen as a standard Gaussian𝒩\(0,𝐈\)\\mathcal\{N\}\(0,\\mathbf\{I\}\), while𝐱θ\(𝐱\(t\),t\)\\mathbf\{x\}\_\{\\theta\}\(\\mathbf\{x\}^\{\(t\)\},t\)is the predicted clean sample𝐱\(0\)\\mathbf\{x\}^\{\(0\)\}from the noisy input𝐱\(t\)\\mathbf\{x\}^\{\(t\)\}, andΣt\\Sigma\_\{t\}is typically a fixed variance function\.
### III\-BConditional DDPM For Time Series Forecasting
In time series forecasting, we extend the DDPM framework to handle conditional inputs\. Let𝐜\\mathbf\{c\}represent the conditioning signals; the goal of the denoising network is to predict the future horizon,𝐱\(0\)≡𝐱L\+1:L\+H=⟨𝐱L\+1,𝐱L\+2,…𝐱L\+H⟩\\mathbf\{x\}^\{\(0\)\}\\equiv\\mathbf\{x\}\_\{L\+1:L\+H\}=\\langle\\mathbf\{x\}\_\{L\+1\},\\mathbf\{x\}\_\{L\+2\},\\ldots\\mathbf\{x\}\_\{L\+H\}\\rangle, based on the noisy future time series𝐱\(t\)\\mathbf\{x\}^\{\(t\)\}and the condition𝐜\\mathbf\{c\}\. The denoising objective is formulated as:
ℒ\(θ\)=𝔼𝐱\(0\),t,ϵ\[‖𝐱\(0\)−𝐱θ\(𝐱\(t\),t,𝐜\)‖22\]\.\\mathcal\{L\}\(\\theta\)=\\mathbb\{E\}\_\{\\mathbf\{x\}^\{\(0\)\},t,\\boldsymbol\{\\epsilon\}\}\\Big\[\\big\\\|\\mathbf\{x\}^\{\(0\)\}\-\\mathbf\{x\}\_\{\\theta\}\(\\mathbf\{x\}^\{\(t\)\},t,\\mathbf\{c\}\)\\big\\\|\_\{2\}^\{2\}\\Big\]\.\(6\)
Normally,𝐜\\mathbf\{c\}could be the lookback window𝐱1:L\\mathbf\{x\}\_\{1:L\}\. However, in our setting, we also integrate textual context to enrich the condition\. Specifically, for each historical timestepn∈\{1,…,L\}n\\in\\\{1,\\dots,L\\\}, there is a local bagℳn=\{si\}i=1\|ℳn\|\\mathcal\{M\}\_\{n\}=\\\{s\_\{i\}\\\}\_\{i=1\}^\{\|\\mathcal\{M\}\_\{n\}\|\}, which contains textual descriptions of events occurring at that point\.
## IVMethodology
### IV\-AFramework Overview
Fig\.[2](https://arxiv.org/html/2608.17164#S4.F2)summarizesScenarioDiff\. Let𝐱1:L∈ℝL\\mathbf\{x\}\_\{1:L\}\\in\\mathbb\{R\}^\{L\}denote the observed lookback window and𝐱L\+1:L\+H∈ℝH\\mathbf\{x\}\_\{L\+1:L\+H\}\\in\\mathbb\{R\}^\{H\}denote the future horizon\. For each historical timestepn∈\{1,…,L\}n\\in\\\{1,\\dots,L\\\}, we assume access to an aligned document setℳn\\mathcal\{M\}\_\{n\}\.ScenarioDifforganizes contextual reasoning into three hierarchical levels\. First, a frozen*Historical Context Agent*mapsℳ1:L\\mathcal\{M\}\_\{1:L\}to*stepwise context summaries*𝐬1:Lctx\\mathbf\{s\}\_\{1:L\}^\{\\mathrm\{ctx\}\}, grounding the model in document\-aligned historical evidence\. Second, a frozen*Scenario Agent*maps\(𝐱1:L,𝐬1:Lctx\)\(\\mathbf\{x\}\_\{1:L\},\\mathbf\{s\}\_\{1:L\}^\{\\mathrm\{ctx\}\}\)to a*scenario description*𝐬scn\\mathbf\{s\}^\{\\mathrm\{scn\}\}, projecting a coarse qualitative prior over the forecast horizon\. Third, an*Anchor Guidance Agent*maps\(𝐱1:L,𝐬1:Lctx,𝐬scn\)\(\\mathbf\{x\}\_\{1:L\},\\mathbf\{s\}\_\{1:L\}^\{\\mathrm\{ctx\}\},\\mathbf\{s\}^\{\\mathrm\{scn\}\}\)to sparse*anchor points*𝒜\\mathcal\{A\}, which provide localized constraints for inference\-time trajectory refinement\.
We instantiate the numerical forecaster as a conditional denoising diffusion model that estimatesp\(𝐱L\+1:L\+H∣𝐱1:L,𝐬1:Lctx,𝐬scn\)\.p\\\!\\left\(\\mathbf\{x\}\_\{L\+1:L\+H\}\\mid\\mathbf\{x\}\_\{1:L\},\\mathbf\{s\}\_\{1:L\}^\{\\mathrm\{ctx\}\},\\mathbf\{s\}^\{\\mathrm\{scn\}\}\\right\)\.Let𝐱\(0\)≡𝐱L\+1:L\+H\\mathbf\{x\}^\{\(0\)\}\\equiv\\mathbf\{x\}\_\{L\+1:L\+H\}be the clean future target\. The forward process corrupts it with Gaussian noise:q\(𝐱\(t\)∣𝐱\(0\)\)=𝒩\(α¯t𝐱\(0\),\(1−α¯t\)𝐈\),q\(\\mathbf\{x\}^\{\(t\)\}\\mid\\mathbf\{x\}^\{\(0\)\}\)=\\mathcal\{N\}\\\!\\left\(\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}\\,\\mathbf\{x\}^\{\(0\)\},\(1\-\\bar\{\\alpha\}\_\{t\}\)\\mathbf\{I\}\\right\),or equivalently,𝐱\(t\)=α¯t𝐱\(0\)\+1−α¯tϵ,ϵ∼𝒩\(𝟎,𝐈\)\.\\mathbf\{x\}^\{\(t\)\}=\\sqrt\{\\bar\{\\alpha\}\_\{t\}\}\\,\\mathbf\{x\}^\{\(0\)\}\+\\sqrt\{1\-\\bar\{\\alpha\}\_\{t\}\}\\,\\boldsymbol\{\\epsilon\},\\qquad\\boldsymbol\{\\epsilon\}\\sim\\mathcal\{N\}\(\\mathbf\{0\},\\mathbf\{I\}\)\.During denoising, the model receives the observed history𝐱1:L\\mathbf\{x\}\_\{1:L\}, the noisy future𝐱\(t\)\\mathbf\{x\}^\{\(t\)\}, and the contextual conditions produced by the Historical Context Agent and the Scenario Agent\. Starting from Gaussian noise, the reverse process generates a trajectory consistent with both numerical history and scenario\-level context\. Anchor points𝒜\\mathcal\{A\}are then used by Anchor Blended Sampling to locally refine the generated trajectory\.
Fig\. 2:ScenarioDiffoverview\.
### IV\-BHierarchical Contextual Reasoning
#### Historical Context Agent
Raw documents aligned with each historical timestep are often verbose, redundant, and only weakly related to the forecasting target\. Directly encoding such documents may obscure useful event signals\. We therefore use a frozen*Historical Context Agent*to compress each local document set into a concise summary\.
For each timestepnn, the agent takesℳn\\mathcal\{M\}\_\{n\}as input and produces a short summarysnctxs\_\{n\}^\{\\mathrm\{ctx\}\}\. If no useful evidence is available, the agent emits a special\[NO\_EVENT\]token\. Collecting these outputs yields the sequence𝐬1:Lctx=⟨s1ctx,…,sLctx⟩\.\\mathbf\{s\}\_\{1:L\}^\{\\mathrm\{ctx\}\}=\\langle s\_\{1\}^\{\\mathrm\{ctx\}\},\\dots,s\_\{L\}^\{\\mathrm\{ctx\}\}\\rangle\.These summaries provide a temporally grounded semantic view of the observed history and serve as the main textual representation of past evidence\.
To obtain continuous conditioning features, each summary is encoded by a text encoderEnctext\(⋅\)\\mathrm\{Enc\}\_\{\\mathrm\{text\}\}\(\\cdot\)followed by an average pooling as:
𝐜nhist=AvgPool\(Enctext\(𝐬nctx\)\),𝐜nhist∈ℝdemb\.\\mathbf\{c\}^\{\\mathrm\{hist\}\}\_\{n\}=\\mathrm\{AvgPool\}\\\!\\left\(\\mathrm\{Enc\}\_\{\\mathrm\{text\}\}\(\\mathbf\{s\}\_\{n\}^\{\\mathrm\{ctx\}\}\)\\right\),\\qquad\\mathbf\{c\}^\{\\mathrm\{hist\}\}\_\{n\}\\in\\mathbb\{R\}^\{d\_\{\\mathrm\{emb\}\}\}\.\(7\)We denote the encoded historical context sequence as𝐂1:Lhist=⟨𝐜1hist,…,𝐜Lhist⟩\\mathbf\{C\}^\{\\mathrm\{hist\}\}\_\{1:L\}=\\langle\\mathbf\{c\}^\{\\mathrm\{hist\}\}\_\{1\},\\dots,\\mathbf\{c\}^\{\\mathrm\{hist\}\}\_\{L\}\\rangle\. The resulting sequence𝐂hist1:L\\mathbf\{C\}^\{\\mathrm\{hist\}\}\_\{1:L\}is later injected into the historical tokens of the diffusion forecaster\.
#### Scenario Agent
While the stepwise context summaries capture fine\-grained historical evidence, forecasting also benefits from a global qualitative hypothesis about the future horizon\. We introduce a frozen*Scenario Agent*, which generates a*scenario description*from the observed history and the stepwise context summaries:𝐬scn=LLM\(𝐱1:L,𝐬1:Lctx\)\.\\mathbf\{s\}^\{\\mathrm\{scn\}\}=\\mathrm\{LLM\}\(\\mathbf\{x\}\_\{1:L\},\\mathbf\{s\}\_\{1:L\}^\{\\mathrm\{ctx\}\}\)\.Because the same history\-only procedure is used in both training and inference, this design avoids temporal leakage\.
The scenario description is a short natural\-language statement about expected future behavior, such as overall direction, volatility, or likely disruptions\. We encode it with the same text encoderEnctext\(⋅\)\\mathrm\{Enc\}\_\{\\mathrm\{text\}\}\(\\cdot\):
𝐂scn=Enctext\(𝐬scn\),𝐂scn∈ℝNf×demb\.\\displaystyle\\mathbf\{C\}^\{\\mathrm\{scn\}\}=\\mathrm\{Enc\}\_\{\\mathrm\{text\}\}\(\\mathbf\{s\}^\{\\mathrm\{scn\}\}\),\\qquad\\mathbf\{C\}^\{\\mathrm\{scn\}\}\\in\\mathbb\{R\}^\{N\_\{f\}\\times d\_\{\\mathrm\{emb\}\}\}\.\(8\)This representation serves as a horizon\-level prior for the diffusion forecaster\.
#### Scenario Consistency Score
For analysis only, we define a Scenario Consistency Score \(SCS\) to measure whether the generated scenario is semantically close to what actually occurs\. Let𝐬^oraclescn\\hat\{\\mathbf\{s\}\}^\{\\mathrm\{scn\}\}\_\{\\mathrm\{oracle\}\}be an oracle scenario description obtained by summarizing the ground\-truth future𝐱L\+1:L\+H\\mathbf\{x\}\_\{L\+1:L\+H\}with the same prompt\. This oracle is never used during training or inference\. We compute SCS using a separate sentence\-level diagnostic encoderEncdiag\(⋅\)\\operatorname\{Enc\}\{\\mathrm\{diag\}\}\(\\cdot\):
SCS\(𝐬scn\)=cos\(Enctext\(𝐬scn\),Enctext\(𝐬^oraclescn\)\)\.\\mathrm\{SCS\}\(\\mathbf\{s\}^\{\\mathrm\{scn\}\}\)=\\cos\\\!\\left\(\\mathrm\{Enc\}\_\{\\mathrm\{text\}\}\(\\mathbf\{s\}^\{\\mathrm\{scn\}\}\),\\mathrm\{Enc\}\_\{\\mathrm\{text\}\}\(\\hat\{\\mathbf\{s\}\}^\{\\mathrm\{scn\}\}\_\{\\mathrm\{oracle\}\}\)\\right\)\.\(9\)
A higher SCS indicates stronger semantic agreement between the generated scenario and the realized future\. We use SCS alongside distributional metrics \(MMD, Fréchet distance\) in our empirical analysis to verify that generated scenarios carry meaningful signal above noise baselines \(Section[V\-C](https://arxiv.org/html/2608.17164#S5.SS3)\)\.
#### Anchor Guidance Agent
The scenario description provides a coarse future prior, but it does not directly specify where abrupt changes may occur\. We therefore introduce an*Anchor Guidance Agent*, which converts the available context into sparse*anchor points*for inference\-time guidance\.
Given𝐱1:L\\mathbf\{x\}\_\{1:L\},𝐬1:Lctx\\mathbf\{s\}\_\{1:L\}^\{\\mathrm\{ctx\}\}, and𝐬scn\\mathbf\{s\}^\{\\mathrm\{scn\}\}, the Anchor Guidance Agent outputs a set ofMManchor points𝒜=\{\(tj,lj,uj,wj\)\}j=1M,\\mathcal\{A\}=\\\{\(t\_\{j\},l\_\{j\},u\_\{j\},w\_\{j\}\)\\\}\_\{j=1\}^\{M\},wheretj∈\{L\+1,…,L\+H\}t\_\{j\}\\in\\\{L\+1,\\dots,L\+H\\\}is a future timestep,\[lj,uj\]\[l\_\{j\},u\_\{j\}\]is a plausible value interval, andwjw\_\{j\}is a confidence weight\. We define
wj=clip\(c\(1\+1ε\+\|uj−lj\|\),0,wmax\),\\displaystyle w\_\{j\}=\\mathrm\{clip\}\\\!\\left\(c\\left\(1\+\\frac\{1\}\{\\varepsilon\+\|u\_\{j\}\-l\_\{j\}\|\}\\right\),0,w\_\{\\max\}\\right\),\(10\)so that tighter intervals yield stronger guidance\. These anchor points provide time\-localized structure that complements the global scenario description and are used during inference to refine sampled trajectories\.
### IV\-CMultimodal Diffusion Transformer
#### Architecture
We choose aTransformer\-based denoising architecture that enhances the model’s ability to capture the conditioning signal for time series\. Given an input time series, we first applyRevIN\[[9](https://arxiv.org/html/2608.17164#bib.bib33)\]to reduce temporal distribution shift and outlier effects\.
The normalized series is then transformed into tokens by a tokenization moduleΦts\(⋅\)\\Phi\_\{\\mathrm\{ts\}\}\(\\cdot\), which incorporates the diffusion step embeddingtt:𝐙0=Φts\(RevIN\(\[𝐱1:L;𝐱L\+1:L\+H\(t\)\]\),t\)\.\\mathbf\{Z\}\_\{0\}=\\Phi\_\{\\mathrm\{ts\}\}\\\!\\left\(\\mathrm\{RevIN\}\(\[\\mathbf\{x\}\_\{1:L\};\\mathbf\{x\}^\{\(t\)\}\_\{L\+1:L\+H\}\]\),t\\right\)\.
#### Token Distiller
The textual conditions can be long, especially when many historical summaries are available\. To reduce computation, we compress long contextual token sequences𝐂hist\\mathbf\{C\}^\{\\text\{hist\}\}and𝐂scn\\mathbf\{C\}^\{\\text\{scn\}\}into a compact window ofQQdistilled tokens, whereQ≪LQ\\ll L\. We introduce learnable prototype queries𝐑∈ℝQ×D\\mathbf\{R\}\\in\\mathbb\{R\}^\{Q\\times D\}and obtain the distilled context through cross\-attention:
𝐂distillctx\\displaystyle\\mathbf\{C\}^\{\\text\{ctx\}\}\_\{\\text\{distill\}\}=CrossAttn\(𝐑,𝐂ctx\)∈ℝQ×D,\\displaystyle=\\operatorname\{CrossAttn\}\(\\mathbf\{R\},\\mathbf\{C\}^\{\\text\{ctx\}\}\)\\in\\mathbb\{R\}^\{Q\\times D\},\(11\)𝐂distillscn\\displaystyle\\mathbf\{C\}^\{\\text\{scn\}\}\_\{\\text\{distill\}\}=CrossAttn\(𝐑,𝐂scn\)∈ℝQ×D\.\\displaystyle=\\operatorname\{CrossAttn\}\(\\mathbf\{R\},\\mathbf\{C\}^\{\\text\{scn\}\}\)\\in\\mathbb\{R\}^\{Q\\times D\}\.\(12\)
Here,𝐑\\mathbf\{R\}acts as a set of adaptive semantic anchors that selectively aggregate information from the full context\. Padding tokens are masked during attention, and fully masked sequences are mapped to zero outputs for stability\. The distilled tokens are then integrated into theTransformerdecoder layers through a cross\-attention module\. This module, therefore, replaces the original long context with fixed\-size distilled representations, preserving salient global information while reducing the computational cost of downstream reasoning\.
#### Condition Injection
To inject conditional information during reverse denoising, the model uses adaptive layer normalization \(AdaLN\)\[[12](https://arxiv.org/html/2608.17164#bib.bib35)\]\. Specifically, the diffusion\-step embedding and the distilled contextual representations generate scale and shift parameters forTransformerhidden states\. This allows the denoising network to adapt its computation at each diffusion step according to both temporal noise level and multimodal context\.
Algorithm 1Asymmetric conditioning inScenarioDiff1:
𝐱1:L\\mathbf\{x\}\_\{1:L\},
𝐱\(t\)L\+1:L\+H\\mathbf\{x\}^\{\(t\)\}\_\{L\+1:L\+H\},
𝐬ctx1:L\\mathbf\{s\}^\{\\mathrm\{ctx\}\}\_\{1:L\},
𝐬scn\\mathbf\{s\}^\{\\mathrm\{scn\}\}, step
tt
2:
𝐱^\(0\)L\+1:L\+H\\hat\{\\mathbf\{x\}\}^\{\(0\)\}\_\{L\+1:L\+H\}
3:Timestep tokenization:
4:
𝐙0←Φts\(RevIN\(\[𝐱1:L;𝐱L\+1:L\+H\(t\)\]\),t\)\\mathbf\{Z\}\_\{0\}\\leftarrow\\Phi\_\{\\mathrm\{ts\}\}\(\\operatorname\{RevIN\}\(\[\\mathbf\{x\}\_\{1:L\};\\mathbf\{x\}^\{\(t\)\}\_\{L\+1:L\+H\}\]\),t\)
5:Text encoding:
6:
𝐂¯h←Distill\(Enctext\(𝐬1:Lctx\)\)\\bar\{\\mathbf\{C\}\}\_\{h\}\\leftarrow\\operatorname\{Distill\}\(\\operatorname\{Enc\}\_\{\\mathrm\{text\}\}\(\\mathbf\{s\}^\{\\mathrm\{ctx\}\}\_\{1:L\}\)\)
7:
𝐂¯s←Distill\(Enctext\(𝐬scn\)\)\\bar\{\\mathbf\{C\}\}\_\{s\}\\leftarrow\\operatorname\{Distill\}\(\\operatorname\{Enc\}\_\{\\mathrm\{text\}\}\(\\mathbf\{s\}^\{\\mathrm\{scn\}\}\)\)
8:for
ℓ=0,…,D−1\\ell=0,\\ldots,D\-1do
9:Split tokens:
10:
𝐇ℓ←𝐙ℓ,1:L,𝐅ℓ←𝐙ℓ,L\+1:L\+H\\mathbf\{H\}\_\{\\ell\}\\leftarrow\\mathbf\{Z\}\_\{\\ell,1:L\},\\hskip 9\.24994pt\\mathbf\{F\}\_\{\\ell\}\\leftarrow\\mathbf\{Z\}\_\{\\ell,L\+1:L\+H\}
11:Inject historical context:
12:
𝐇~ℓ←𝐇ℓ\+ψh\(𝐂h¯\)\\tilde\{\\mathbf\{H\}\}\_\{\\ell\}\\leftarrow\\mathbf\{H\}\_\{\\ell\}\+\\psi\_\{h\}\(\\bar\{\\mathbf\{C\}\_\{h\}\}\)
13:Inject scenario guidance:
14:
𝐅~ℓ←𝐅ℓ\+CA\(𝐅ℓ,𝐂¯s,𝐂¯s\)\\tilde\{\\mathbf\{F\}\}\_\{\\ell\}\\leftarrow\\mathbf\{F\}\_\{\\ell\}\+\\operatorname\{CA\}\(\\mathbf\{F\}\_\{\\ell\},\\bar\{\\mathbf\{C\}\}\_\{s\},\\bar\{\\mathbf\{C\}\}\_\{s\}\)
15:Joint denoising update:
16:
𝐙ℓ\+1←ℬℓ\(\[𝐇~ℓ;𝐅~ℓ\],t\)\\mathbf\{Z\}\_\{\\ell\+1\}\\leftarrow\\mathcal\{B\}\_\{\\ell\}\(\[\\tilde\{\\mathbf\{H\}\}\_\{\\ell\};\\tilde\{\\mathbf\{F\}\}\_\{\\ell\}\],t\)
17:endfor
18:Future reconstruction:
19:
𝐱^L\+1:L\+H\(0\)←RevIN−1\(Head\(𝐙D,L\+1:L\+H\)\)\\hat\{\\mathbf\{x\}\}^\{\(0\)\}\_\{L\+1:L\+H\}\\leftarrow\\operatorname\{RevIN\}^\{\-1\}\(\\operatorname\{Head\}\(\\mathbf\{Z\}\_\{D,L\+1:L\+H\}\)\)
20:return
𝐱^\(0\)L\+1:L\+H\\hat\{\\mathbf\{x\}\}^\{\(0\)\}\_\{L\+1:L\+H\}
The detailed architecture is summarized in Alg\.[1](https://arxiv.org/html/2608.17164#alg1)\. Here,Φts\\Phi\_\{\\mathrm\{ts\}\}denotes time\-series tokenization,ψh\\psi\_\{h\}is the additive history\-side injection MLP,CA\\operatorname\{CA\}denotes cross\-attention,ℬℓ\\mathcal\{B\}\_\{\\ell\}denotes anAdaLNTransformerblock, andDistill\\operatorname\{Distill\}compresses long contextual token sequences using learnable prototype queries\.
Finally, the resulting patch tokens are processed by a stack ofTransformerencoder layers with self\-attention and feed\-forward blocks, and a lightweight flatten\-linear decoder maps the final hidden representations back to the reconstructed denoised time series\.
### IV\-DAnchor Blended Sampling
After standard reverse diffusion, we obtain an initial forecast𝐱θ\(0\)\\mathbf\{x\}^\{\(0\)\}\_\{\\theta\}, which is used as the source trajectory for a post\-hoc editing stage\. Anchor Blended Sampling refines this source trajectory by editing anchor\-relevant regions while preserving the remaining temporal structure\. Unlike image\-based blended diffusion, which often uses CLIP guidance\[[2](https://arxiv.org/html/2608.17164#bib.bib37)\], our refinement is defined by the distance\-to\-band objectiveℒanch\(𝐱,𝒜\)\\mathcal\{L\}\_\{\\mathrm\{anch\}\}\(\\mathbf\{x\};\\mathcal\{A\}\)\.
Alg\.[2](https://arxiv.org/html/2608.17164#alg2)summarizes the complete refinement procedure\. Given anchors𝒜=\{\(tj,lj,uj,wj\)\}j=1M\\mathcal\{A\}=\\\{\(t\_\{j\},l\_\{j\},u\_\{j\},w\_\{j\}\)\\\}\_\{j=1\}^\{M\}, we evaluate whether the trajectory satisfies each anchor interval within a local temporal window by a refinement loss:
ℒanch\(𝐱;𝒜\)=−τ∑j=1MwjLogSumExp\(−d\(𝐱tj−r:tj\+r,\[lj,uj\]\)τ\),\\small\\mathcal\{L\}\_\{\\mathrm\{anch\}\}\(\\mathbf\{x\};\\mathcal\{A\}\)=\-\\tau\\sum\_\{j=1\}^\{M\}w\_\{j\}\\,\\mathrm\{LogSumExp\}\\\!\\Big\(\-\\frac\{d\(\\mathbf\{x\}\_\{t\_\{j\}\-r:t\_\{j\}\+r\},\[l\_\{j\},u\_\{j\}\]\)\}\{\\tau\}\\Big\),\(13\)whered\(⋅,\[lj,uj\]\)=\(max\(0,lj−x\)\+max\(0,x−uj\)\)2d\(\\cdot;\[l\_\{j\},u\_\{j\}\]\)=\\left\(\\max\(0,l\_\{j\}\-x\)\+\\max\(0,x\-u\_\{j\}\)\\right\)^\{2\}penalizes values outside the anchor band andrrallows small temporal shifts\.
Algorithm 2Anchor Blended Sampling1:diffusion model
𝐱θ\\mathbf\{x\}\_\{\\theta\}, anchors
𝒜\\mathcal\{A\}, mask
𝐦\\mathbf\{m\}, edit steps
TeT\_\{e\}, scales
\{γt\}t=1Te\\\{\\gamma\_\{t\}\\\}\_\{t=1\}^\{T\_\{e\}\}
2:refined sample
𝐱\(0\)\\mathbf\{x\}^\{\(0\)\}
3:Sample
𝐱\(T\)∼𝒩\(𝟎,𝐈\)\\mathbf\{x\}^\{\(T\)\}\\sim\\mathcal\{N\}\(\\mathbf\{0\},\\mathbf\{I\}\)
4:for
t=T,…,1t=T,\\ldots,1do
5:Draw
𝐱\(t−1\)\\mathbf\{x\}^\{\(t\-1\)\}using the reverse diffusion kernel\.
6:endfor
7:Set source trajectory
𝐱θ\(0\)←𝐱\(0\)\\mathbf\{x\}^\{\(0\)\}\_\{\\theta\}\\leftarrow\\mathbf\{x\}^\{\(0\)\}
8:Noise the source to level
TeT\_\{e\}:
𝐱θ\(Te\)∼q\(𝐱\(Te\)∣𝐱θ\(0\)\)\\mathbf\{x\}^\{\(T\_\{e\}\)\}\_\{\\theta\}\\sim q\(\\mathbf\{x\}^\{\(T\_\{e\}\)\}\\mid\\mathbf\{x\}^\{\(0\)\}\_\{\\theta\}\)
9:for
t=Te,…,1t=T\_\{e\},\\ldots,1do
10:Estimate posterior parameters
μt,Σt\\mu\_\{t\},\\Sigma\_\{t\}
11:
gt←−∇𝐱\(t\)ℒanch\(𝐱θ\(𝐱\(t\),t\),𝒜\)g\_\{t\}\\leftarrow\-\\nabla\_\{\\mathbf\{x\}^\{\(t\)\}\}\\mathcal\{L\}\_\{\\mathrm\{anch\}\}\(\\mathbf\{x\}\_\{\\theta\}\(\\mathbf\{x\}^\{\(t\)\},t\);\\mathcal\{A\}\)
12:
𝐱~\(t−1\)∼𝒩\(μt\+γtΣtgt,Σt\)\\tilde\{\\mathbf\{x\}\}^\{\(t\-1\)\}\\sim\\mathcal\{N\}\(\\mu\_\{t\}\+\\gamma\_\{t\}\\Sigma\_\{t\}g\_\{t\},\\Sigma\_\{t\}\)
13:Draw
𝐱θ\(t−1\)∼q\(𝐱\(t−1\)∣𝐱θ\(0\)\)\\mathbf\{x\}^\{\(t\-1\)\}\_\{\\theta\}\\sim q\(\\mathbf\{x\}^\{\(t\-1\)\}\\mid\\mathbf\{x\}^\{\(0\)\}\_\{\\theta\}\)
14:
𝐱\(t−1\)←𝐦⊙𝐱~\(t−1\)\+\(1−𝐦\)⊙𝐱θ\(t−1\)\\mathbf\{x\}^\{\(t\-1\)\}\\leftarrow\\mathbf\{m\}\\odot\\tilde\{\\mathbf\{x\}\}^\{\(t\-1\)\}\+\(1\-\\mathbf\{m\}\)\\odot\\mathbf\{x\}^\{\(t\-1\)\}\_\{\\theta\}
15:endfor
16:return
𝐱\(0\)\\mathbf\{x\}^\{\(0\)\}
Starting from a noised version𝐱\(Te\)\\mathbf\{x\}^\{\(T\_\{e\}\)\}of the generated source𝐱θ\(0\)\\mathbf\{x\}^\{\(0\)\}\_\{\\theta\}, we run a short reverse editing process\. At each timesteptt, the posterior estimation𝐱~\(t−1\)\\tilde\{\\mathbf\{x\}\}^\{\(t\-1\)\}is updated using the negative gradient of the anchor loss:
pθ\(𝐱~\(t−1\)∣𝐱\(t\)\)\\displaystyle p\_\{\\theta\}\(\\tilde\{\\mathbf\{x\}\}^\{\(t\-1\)\}\\mid\\mathbf\{x\}^\{\(t\)\}\)=𝒩\(μt\+γtΣtgt,Σt\),\\displaystyle=\\mathcal\{N\}\(\\mu\_\{t\}\+\\gamma\_\{t\}\\Sigma\_\{t\}g\_\{t\},\\Sigma\_\{t\}\),gt\\displaystyle g\_\{t\}=−∇𝐱\(t\)ℒanch\(𝐱θ\(𝐱\(t\),t\),𝒜\)\.\\displaystyle=\-\\nabla\_\{\\mathbf\{x\}^\{\(t\)\}\}\\mathcal\{L\}\_\{\\mathrm\{anch\}\}\(\\mathbf\{x\}\_\{\\theta\}\(\\mathbf\{x\}^\{\(t\)\},t\);\\mathcal\{A\}\)\.
Here,γt\\gamma\_\{t\}controls the guidance strength\. To preserve non\-anchor regions, we blend the guided latent with a noised version of𝐱θ\(0\)\\mathbf\{x\}^\{\(0\)\}\_\{\\theta\}:
𝐱\(t−1\)\\displaystyle\\mathbf\{x\}^\{\(t\-1\)\}=𝐦⊙𝐱~\(t−1\)\+\(1−𝐦\)⊙𝐱θ\(t−1\),\\displaystyle=\\mathbf\{m\}\\odot\\tilde\{\\mathbf\{x\}\}^\{\(t\-1\)\}\+\(1\-\\mathbf\{m\}\)\\odot\\mathbf\{x\}^\{\(t\-1\)\}\_\{\\theta\},𝐱θ\(t−1\)\\displaystyle\\mathbf\{x\}^\{\(t\-1\)\}\_\{\\theta\}∼𝒩\(α¯t−1𝐱θ\(0\),\(1−α¯t−1\)𝐈\),\\displaystyle\\sim\\mathcal\{N\}\(\\sqrt\{\\bar\{\\alpha\}\_\{t\-1\}\}\\,\\mathbf\{x\}^\{\(0\)\}\_\{\\theta\},\(1\-\\bar\{\\alpha\}\_\{t\-1\}\)\\,\\mathbf\{I\}\),where𝐦\\mathbf\{m\}marks the anchor\-relevant temporal regions\. Thus, the base diffusion model generates a plausible trajectory, and the second energy\-guided blended refinement locally corrects it according to the anchor constraints without requiring retraining\.
## VExperiments
### V\-AExperimental Settings
#### Dataset
We evaluate on theTime\-MMDbenchmark\[[15](https://arxiv.org/html/2608.17164#bib.bib5)\], a multi\-domain multimodal dataset for time series analysis\.Time\-MMDcontains paired numerical and textual data from real\-world domains:Economy,Energy,Security,Social Good, andTraffic\. The series are sampled at a weekly or monthly frequency and cover long temporal ranges from 1950 to 2024\. Each numerical target is associated with aligned textual facts and reports, making the benchmark suitable for evaluating forecasting models that use both numerical histories and contextual text\. Following the officialMM\-TSFlibprotocol\[[15](https://arxiv.org/html/2608.17164#bib.bib5)\], we use the standard train/validation/test split with a ratio of 7:1:2\.
#### Forecasting Setup
For monthly time series, we use a lookback length ofL=36L=36and prediction horizonsH∈\{6,12,18\}H\\in\\\{6,12,18\\\}\. For weekly time series, we useL=96L=96and horizonsH∈\{12,24,48\}H\\in\\\{12,24,48\\\}\. For brevity, we report results averaged over all prediction horizons for each domain\.
#### Baselines
We compareScenarioDiffwith four groups of baselines\. The first group includes numerical\-only forecasters, covering Transformer\-based models such asInformer\[[42](https://arxiv.org/html/2608.17164#bib.bib27)\],FEDformer\[[44](https://arxiv.org/html/2608.17164#bib.bib24)\], andiTransformer\[[18](https://arxiv.org/html/2608.17164#bib.bib25)\]\. The second group includes LLM\-prior methods, represented byTime\-LLM\[[7](https://arxiv.org/html/2608.17164#bib.bib2)\]andS2IP\-LLM\[[22](https://arxiv.org/html/2608.17164#bib.bib21)\]\. The third group contains multimodal forecasting methods that use paired text, includingTaTS\[[14](https://arxiv.org/html/2608.17164#bib.bib6)\]andMM\-TSF\[[15](https://arxiv.org/html/2608.17164#bib.bib5)\]\. The fourth group consists of probabilistic diffusion\-based models such asCSDI\[[30](https://arxiv.org/html/2608.17164#bib.bib13)\]andTMDM\[[13](https://arxiv.org/html/2608.17164#bib.bib38)\]; for these models, we additionally report CRPS\. We follow theTSLib\[[33](https://arxiv.org/html/2608.17164#bib.bib40)\]andMM\-TSFlib\[[15](https://arxiv.org/html/2608.17164#bib.bib5)\]settings when available and tune hyperparameters on the validation set\. Full baseline citations are given in Table[I](https://arxiv.org/html/2608.17164#S5.T1)\.
#### Metrics
We evaluate the deterministic forecasting accuracy using Mean Squared Error \(MSE\) and Mean Absolute Error \(MAE\) on standardized time series\. For stochastic forecasting models, we additionally report the Continuous Ranked Probability Score \(CRPS\), which measures the quality of the predictive distribution\. Lower values indicate better performance for all metrics\.
#### Hyperparameters and Implementation Details
All models are implemented in PyTorch and trained on a single NVIDIA H100 GPU\. Across theTime\-MMDexperiments, the diffusion forecaster usesD=6D=6residual blocks, hidden dimensiond∈\{64,128,256\}d\\in\\\{64,128,256\\\}, and 8 attention heads\. Models are trained with Adam for 60–150 epochs, with batch size selected from\{16,32\}\\\{16,32\\\}, learning rate from\{10−4,5×10−4\}\\\{10^\{\-4\},5\\times 10^\{\-4\}\\\}, and weight decay10−610^\{\-6\}\. Forecast trajectories are generated usingDDIM\[[27](https://arxiv.org/html/2608.17164#bib.bib44)\]with 50 sampling steps\.
The Historical Context, Scenario, and Anchor Guidance Agents useGemini 2\.5 Flash\. Agent outputs are generated offline and cached before training and inference\. Text inputs are truncated to 512 tokens and encoded with a frozenbert\-base\-uncasedencoder, yieldingdemb=768d\_\{\\mathrm\{emb\}\}=768representations\. To avoid temporal leakage, each forecast origin uses only documents and textual representations aligned with observed timesteps\.
For Anchor Blended Sampling, we retain at most five anchor intervals, construct the edit mask with radiusr=2r=2, set the soft\-min temperature toτ=0\.10\\tau=0\.10, and performNedit=6N\_\{\\mathrm\{edit\}\}=6guidedDDIMreverse\-editing steps\. The anchor gradient is mask\-restricted, clipped to unit norm, and applied with guidance scaleγ=50\\gamma=50; non\-anchor regions are blended with the noised source forecast\.
### V\-BMain Results
Table I:Overall results onTime\-MMD\. The best, runner\-up, and third\-best mean results are highlighted inred,blue, andbold, respectively\.Hor\. 1stcounts the number of first\-place results over all horizon\-domain\-metric entries, whileOvr\. 1stcounts first\-place results after averaging over horizons within each domain and metric\.ModelsHor\. 1stOvr\. 1stEconomyEnergySecuritySocial GoodTrafficMSEMAEMSEMAEMSEMAEMSEMAEMSEMAEInformer\[[42](https://arxiv.org/html/2608.17164#bib.bib27)\]000\.8910\.7740\.4560\.525127\.5566\.5950\.9730\.5990\.2480\.405Reformer\[[10](https://arxiv.org/html/2608.17164#bib.bib28)\]001\.0360\.8530\.6760\.632122\.8356\.2851\.0460\.6470\.2920\.443Autoformer\[[34](https://arxiv.org/html/2608.17164#bib.bib22)\]000\.3400\.4650\.4780\.527112\.7825\.3141\.6180\.8100\.2400\.301FEDformer\[[44](https://arxiv.org/html/2608.17164#bib.bib24)\]200\.2860\.4100\.3940\.457113\.7255\.3821\.2380\.6660\.2310\.271PatchTST\[[20](https://arxiv.org/html/2608.17164#bib.bib34)\]530\.2550\.3870\.2030\.32691\.7345\.4291\.1000\.5590\.1020\.178iTransformer\[[18](https://arxiv.org/html/2608.17164#bib.bib25)\]520\.2800\.3980\.2270\.344113\.2485\.4321\.2350\.5680\.2080\.238PAttn\[[29](https://arxiv.org/html/2608.17164#bib.bib43)\]300\.2370\.3760\.2670\.38883\.1174\.9561\.1960\.5690\.1040\.181DLinear\[[38](https://arxiv.org/html/2608.17164#bib.bib23)\]000\.5790\.6360\.3910\.448106\.5044\.6651\.5240\.9350\.2840\.415FiLM\[[43](https://arxiv.org/html/2608.17164#bib.bib26)\]000\.4600\.5560\.3750\.469108\.1795\.1581\.6080\.9490\.2360\.326TSMixer\[[3](https://arxiv.org/html/2608.17164#bib.bib41)\]101\.9731\.1550\.4100\.48294\.5035\.7351\.3010\.7960\.8180\.714TiDE\[[4](https://arxiv.org/html/2608.17164#bib.bib42)\]000\.4630\.5480\.4840\.51891\.4985\.5481\.9391\.0450\.2300\.378Time\-LLM\[[7](https://arxiv.org/html/2608.17164#bib.bib2)\]000\.3460\.4690\.4640\.49179\.9454\.7851\.9241\.0710\.1950\.330S2IP\-LLM\[[22](https://arxiv.org/html/2608.17164#bib.bib21)\]400\.2730\.4170\.2240\.34376\.1844\.3811\.0250\.5940\.1910\.310TaTS\[[14](https://arxiv.org/html/2608.17164#bib.bib6)\]730\.9240\.7320\.4570\.540124\.4576\.3680\.8860\.5410\.1840\.312MM\-TSF\[[15](https://arxiv.org/html/2608.17164#bib.bib5)\]000\.8160\.7370\.3970\.481127\.4606\.5730\.9590\.5800\.2290\.382CSDI\[[30](https://arxiv.org/html/2608.17164#bib.bib13)\]431\.3960\.9430\.5450\.53196\.3726\.0920\.9080\.4910\.1240\.256TMDM\[[13](https://arxiv.org/html/2608.17164#bib.bib38)\]311\.0380\.7650\.3200\.39876\.2704\.1771\.3050\.6730\.1030\.187NsDiff\[[37](https://arxiv.org/html/2608.17164#bib.bib39)\]101\.7811\.2000\.2450\.403100\.4226\.3563\.1091\.5270\.2550\.437TimeDiff\[[26](https://arxiv.org/html/2608.17164#bib.bib17)\]003\.3721\.7181\.0150\.799102\.1576\.5412\.2341\.1882\.4881\.521ScenarioDiff1340\.2160\.3530\.2250\.36774\.8024\.2611\.3130\.7070\.0990\.183Table[I](https://arxiv.org/html/2608.17164#S5.T1)reports average MSE and MAE over prediction horizons across the fiveTime\-MMDdomains\. Overall,ScenarioDiffachieves the strongest horizon\-level performance, with the largest number of MSE/MAE wins across horizons and domains\. The gains are most evident in event\-driven domains, especiallyEconomyandSecurity, whileScenarioDiffalso shows competitive performance onTraffic\. These results suggest that noisy documents become more effective for forecasting when transformed into explicit scenario\-level signals, rather than fused as unstructured text\. Compared with numerical\-only and LLM\-prior baselines,ScenarioDiffbenefits from using LLM agents for contextual reasoning instead of direct numerical prediction\. The agents extract historical evidence, generate scenario descriptions, and produce anchor points that guide a dedicated probabilistic forecaster\. This separation of historical context, scenario\-level guidance, and anchor\-based refinement leads to stronger performance when text contains actionable event signals\.
Table II:Average CRPS over prediction horizons for representative diffusion\-based probabilistic forecasting models\. We additionally report the average over event\-driven domains, where textual scenarios provide actionable future signals\.Table[II](https://arxiv.org/html/2608.17164#S5.T2)reports CRPS for representative diffusion\-based probabilistic forecasting models\.ScenarioDiffachieves the best event\-domain average CRPS, indicating that hierarchical scenario guidance can also improve predictive distributions when textual evidence is informative\. The improvement is not uniform across all domains, as strong numerical or diffusion\-based baselines remain competitive in some settings\. This domain\-dependent behavior supports our main motivation: scenario\-level guidance is most beneficial when external textual evidence provides actionable signals about future dynamics\.
### V\-CAblation Studies
#### Contribution of Components
We evaluate the contribution of the three agent modules inScenarioDiffby removing one component at a time\. Fig\.[3](https://arxiv.org/html/2608.17164#S5.F3)compares the full model with three variants: w/o Historical Context Agent \(\-His\.\), w/o Scenario Agent \(\-Scn\.\), and w/o Anchor Guidance Agent \(\-Anchor\)\. Each bar reports the absolute MSE/MAE of the corresponding variant, so larger values indicate worse forecasting accuracy\.
Full\-Scn\.\-Hist\.\-Anchor000\.10\.10\.20\.20\.30\.30\.40\.4ErrorMSEMAE\(a\)EconomyFull\-Scn\.\-Hist\.\-Anchor000\.10\.10\.20\.20\.30\.30\.40\.40\.50\.5Error\(b\)EnergyFull\-Scn\.\-Hist\.\-Anchor002020404060608080100100Error\(c\)SecurityFull\-Scn\.\-Hist\.\-Anchor000\.50\.5111\.51\.5222\.52\.5Error\(d\)Social Good
Fig\. 3:Ablation study across four domains\. Each subfigure reports the absolute MSE and MAE of the fullScenarioDiffmodel and variants without the Scenario Agent, Historical Context Agent, and Anchor Guidance Agent\.The results show that all three modules contribute to the final performance\. Removing the Historical Context Agent causes the largest degradation in most domains, indicating that document\-aligned historical evidence is important for grounding the forecast\. Removing the Scenario Agent also hurts performance, especially in event\-driven domains, confirming the value of forecast\-horizon scenario descriptions\. Removing the Anchor Guidance Agent leads to a smaller but consistent drop, suggesting that anchor guidance mainly acts as an inference\-time refinement mechanism\. Overall, the ablation results support the hierarchical design ofScenarioDiff: historical summaries provide grounding, scenario descriptions provide future guidance, and anchor points provide localized refinement\.
#### Event\-driven Subset Analysis
Table III:Average MSE/MAE rank across event\-driven and non\-event\-driven domains\. Ranks are computed over all models in Table[I](https://arxiv.org/html/2608.17164#S5.T1)for each reported MSE and MAE column, while this table reports representative strong baselines for compactness\. Lower rank is better\.To assess where scenario\-level guidance contributes most, we partition theTime\-MMDdomains into event\-driven domains \(Economy,Energy, andSecurity\) and non\-event\-driven domains \(Social GoodandTraffic\)\. Table[III](https://arxiv.org/html/2608.17164#S5.T3)reports the average rank over both MSE and MAE within each partition\.ScenarioDiffachieves the strongest mean rank on event\-driven domains, outperforming representative numerical\-only baselines such asPatchTSTandPAttn, the LLM\-prior methodS2IP\-LLM, and multimodal or diffusion\-based baselines such asTaTSandTMDM\. This result indicates that scenario\-level guidance is most beneficial when external events and textual narratives provide actionable clues about future dynamics\.
In non\-event\-driven domains, the advantage ofScenarioDiffbecomes less pronounced\. Strong numerical\-only, multimodal, and diffusion\-based baselines achieve better average ranks, suggesting that these domains are more dominated by regular temporal patterns and that textual evidence provides fewer actionable signals\. This contrast supports our central motivation: scenario\-level guidance is most useful when future dynamics are shaped by external events that are not fully recoverable from historical values alone\.
#### Quality of LLM\-generated Context
Table IV:Quality of LLM\-generated context in embedding space onEnergy\.Coarseuses history only;Oracleuses future \(reference only\)\.Shuffle/Randombreaks alignment by shuffling contexts or sampling unrelated text\.To verify whether the generated context carries meaningful signal beyond noise, we compare three text sources in SCS \(see Eq\.[9](https://arxiv.org/html/2608.17164#S4.E9)\) onEnergy: \(i\)Coarse, the history\-only scenario generated by the Scenario Agent; \(ii\)Oracle, a reference scenario derived from ground\-truth future values and used only for analysis; and \(iii\) misaligned baselines,Shuffle/Random, which break alignment by shuffling contexts across samples or replacing them with unrelated text\. Table[IV](https://arxiv.org/html/2608.17164#S5.T4)reports semantic and distributional agreement in the diagnosticSentenceTransformer\[[24](https://arxiv.org/html/2608.17164#bib.bib45)\]embedding space\. The generated coarse scenarios are consistently closer to the oracle reference than the misaligned baselines across all metrics, indicating that the Scenario Agent produces contextual signals distinguishable from random or misaligned text\.
#### Anchor Quality Analysis
Table V:Local anchor diagnostic for sparse future anchors\. MSE@r2 and MAE@r2 measure local alignment to each anchor band within radiusr=2r=2\. Gain MSE/MAE reports the endpoint improvement over a mean\-value baseline that predicts the future as a mean trajectory\.For each sparse anchor, we measure whether the predicted trajectory reaches the anchor band within a local radiusr=2r=2\. MSE@r2 and MAE@r2 measure local anchor alignment, while the gain metrics compare endpoint error against a flat mean\-value baseline\.
Table[V](https://arxiv.org/html/2608.17164#S5.T5)shows that anchors can provide useful local signals\.EconomyandTraffichave lower anchor errors and positive endpoint gains, suggesting that their anchors capture meaningful future deviations\. In contrast,Energyhas higher anchor error and negative gain, indicating that inaccurate values or temporal misalignment can misguide anchor\-based refinement\.
This diagnostic complements the full\-horizon ablation: while the ablation evaluates the forecasting benefit of anchor guidance, this analysis examines whether the extracted anchors themselves are reliable\. Overall, anchors are useful as sparse local constraints for abrupt future changes, but their effectiveness depends on anchor quality and temporal alignment\.
#### Parameter Sensitivity of Anchor Guidance
1372050000\.50\.5111\.51\.522Blending windowwwError reduction \(%\)MSEMAE\(a\)Sensitivity of anchor guidance to the blending window size\.Boundaryw=1w=1Moderatew=3w=3–77Widew=20w=20–5050Dense IDense II−0\.5\-0\.5000\.50\.5111\.51\.522Error reduction \(%\)MSEMAE\(b\)Grouped parameter sensitivity of anchor guidance\.
Fig\. 4:Parameter sensitivity of anchor guidance onEconomy\.We analyze the sensitivity of the anchor guidance module onEconomyusing parameter sweeps and report the mean MSE/MAE improvement over the no\-anchor baseline\. As shown in Fig\.[4](https://arxiv.org/html/2608.17164#S5.F4)\(a\), anchor guidance is generally beneficial under stable settings\. Moderate and wide blending windows provide more reliable improvements than very narrow windows, suggesting that anchor information should be incorporated smoothly into the diffusion trajectory rather than imposed as overly local constraints\. The grouped results in Fig\.[4](https://arxiv.org/html/2608.17164#S5.F4)\(b\) further show that increasing the number of anchors or applying stronger anchor expansion does not consistently improve performance\. This suggests that aggressive anchor augmentation may introduce noisy or overly restrictive future constraints\. Overall, the sensitivity analysis indicates that anchor guidance works best with a compact anchor set and a sufficiently wide blending window\.
#### Source\-text perturbation
To evaluate the sensitivity ofScenarioDiffto corrupted textual signals, we perturb the source text at different ratios and report the mean forecasting errors over all prediction horizons\. As shown in Fig\.[6](https://arxiv.org/html/2608.17164#S5.F6), the clean setting achieves the lowest MSE and MAE, indicating that textual context provides useful conditioning information\. As the perturbation ratio increases, forecasting errors generally become larger, although the trend is not strictly monotonic\. This suggests thatScenarioDiffbenefits from informative source text while retaining partial robustness to moderate textual noise\.
00101020203030404050500\.20\.20\.250\.250\.30\.30\.350\.350\.40\.4Perturbed source text \(%\)ErrorMSEMAEFig\. 5:Source\-text perturbation sensitivity onEconomy\.0103050100001010202030304040Noisy anchor contamination \(%\)Change vs\. clean anchor \(%\)MSEMAEFig\. 6:Robustness to noisy anchor contamination onEconomy\.
#### Anchor Noise Sensitivity
To evaluate robustness against erroneous guidance, we contaminate the anchor set with high\-confidence noisy anchors sampled from the tails of each window’s historical distribution\. In Fig\.[6](https://arxiv.org/html/2608.17164#S5.F6), moderate contamination has limited impact on forecasting accuracy, indicating that Anchor Blended Sampling can tolerate a small amount of noisy guidance\. In contrast, severe contamination substantially degrades performance, especially when many noisy anchors are assigned high confidence\. These results suggest that anchor guidance is robust to limited noise but remains sensitive to dense, high\-confidence erroneous anchors\.
### V\-DComputational Cost
We separate offline LLM preprocessing from online forecasting\. The three LLM agents are called once per input instance to generate and cache the stepwise context summaries, scenario description, and anchor points, with average latencies of 8–10 seconds, 13–15 seconds, and around 15 seconds, respectively\. During online forecasting,ScenarioDiffloads the cached agent outputs, encodes them with a frozen text encoder, and performs diffusion sampling\. On a single NVIDIA H100 GPU with batch size 64, inference takes 0\.9–1\.3 seconds per batch usingDDIMwith 50 denoising steps\. This cost is acceptable for weekly or monthly forecasting tasks, butScenarioDiffis not designed for strict real\-time or high\-frequency settings, where repeated LLM preprocessing or multi\-trajectory diffusion sampling may become costly\.
### V\-ECase study
\(a\)Mean forecasts, ground truth, and local anchor bands\.
\(b\)Directionally aligned intrinsic evidence and the realized jump\.
Fig\. 7:Event\-driven case inEnergy\. Historical evidence, scenario guidance, and anchor refinement jointly guide the forecast\. Compared withPatchTST, blending improves the near\-term trajectory and better follows the rising temporal pattern, although the shock magnitude remains underestimated\.We present an event\-driven case study from theEnergydomain to illustrate howScenarioDiffuses contextual evidence\. Fig\.[7](https://arxiv.org/html/2608.17164#S5.F7)\(a\) compares the ground truth, the base diffusion forecast without blending, the anchor\-refined forecast, and thePatchTSTbaseline\. WhilePatchTSTstays close to the historical range and misses the upward transition, Anchor Blended Sampling refines the diffusion trajectory toward the local anchor bands and better follows the realized increase\.
Fig\.[7](https://arxiv.org/html/2608.17164#S5.F7)\(b\) shows the recent weekly observations and stepwise context summaries before the forecast origin\. The summaries consistently indicate continued gasoline\-price increases, providing directional evidence for an upward regime\. The realized jump shortly after the forecast origin supports their role as historical grounding evidence\.
Overall, the case study illustrates the three\-level reasoning process ofScenarioDiff: the Historical Context Agent extracts evidence of recent price increases, the Scenario Agent forms an upward forecast\-horizon scenario, and the Anchor Guidance Agent provides local bands for event\-relevant future steps\. Although the full shock magnitude is still underestimated, the anchor\-refined trajectory better captures the direction and timing of the event\-driven change\.
## VIConclusion
We presentedScenarioDiff, a hierarchical contextual reasoning framework for multimodal time series forecasting\. By organizing contextual information into three levels—historical evidence \(stepwise context summaries\), future hypothesis \(scenario description\), and local constraints \(anchor points\)—ScenarioDiffconditions a Multimodal Diffusion Transformer on structured, interpretable signals rather than raw or implicitly fused text\. Anchor Blended Sampling provides inference\-time trajectory refinement grounded in classifier\-guided diffusion\. Experiments onTime\-MMDconfirm that hierarchical scenario guidance yields the greatest benefit in event\-driven domains, where textual evidence carries actionable signals about future dynamics\. Future work will focus on reducing dependence on external LLMs, improving scenario quality through structured generation, and evaluating the framework across additional multimodal forecasting benchmarks\.
## References
- \[1\]\(2023\)Diffusion\-based time series imputation and forecasting with structured state space models\.Trans\. Mach\. Learn\. Res\.2023\.Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[2\]O\. Avrahami, D\. Lischinski, and O\. Fried\(2022\)Blended diffusion for text\-driven editing of natural images\.InProc\. CVPR,Cited by:[§IV\-D](https://arxiv.org/html/2608.17164#S4.SS4.p1.1),[Remark IV\.1](https://arxiv.org/html/2608.17164#S4.Thmtheorem1.p1.1)\.
- \[3\]S\. Chen, C\. Li, N\. Yoder, S\. Ö\. Arik, and T\. Pfister\(2023\)TSMixer: an all\-mlp architecture for time series forecasting\.CoRRabs/2303\.06053\.Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.12.1.1.1)\.
- \[4\]A\. Das, W\. Kong, A\. Leach, S\. Mathur, R\. Sen, and R\. Yu\(2023\)Long\-term forecasting with tide: time\-series dense encoder\.Trans\. Mach\. Learn\. Res\.2023\.Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.13.1.1.1)\.
- \[5\]P\. Dhariwal and A\. Q\. Nichol\(2021\)Diffusion models beat GANs on image synthesis\.InProc\. NeurIPS,Cited by:[Remark IV\.1](https://arxiv.org/html/2608.17164#S4.Thmtheorem1.p1.1)\.
- \[6\]J\. Ho, A\. Jain, and P\. Abbeel\(2020\)Denoising diffusion probabilistic models\.InProc\. NeurIPS,Cited by:[§III\-A](https://arxiv.org/html/2608.17164#S3.SS1.p1.1)\.
- \[7\]M\. Jin, S\. Wang, L\. Ma, Z\. Chu, J\. Y\. Zhang, X\. Shi, P\. Chen, Y\. Liang, Y\. Li, S\. Pan, and Q\. Wen\(2024\)Time\-LLM: time series forecasting by reprogramming large language models\.InProc\. ICLR,Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p3.1),[§II](https://arxiv.org/html/2608.17164#S2.p1.1),[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.14.1.1.1)\.
- \[8\]D\. Kieu, T\. Kieu, P\. Han, B\. Yang, C\. S\. Jensen, and B\. Le\(2024\)TEAM: topological evolution\-aware framework for traffic forecasting\.Proc\. VLDB Endow\.18\(2\),pp\. 265–278\.Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p1.1)\.
- \[9\]T\. Kim, J\. Kim, Y\. Tae, C\. Park, J\. Choi, and J\. Choo\(2022\)Reversible instance normalization for accurate time\-series forecasting against distribution shift\.InProc\. ICLR,Cited by:[§IV\-C](https://arxiv.org/html/2608.17164#S4.SS3.SSS0.Px1.p1.1)\.
- \[10\]N\. Kitaev, L\. Kaiser, and A\. Levskaya\(2020\)Reformer: the efficient transformer\.InProc\. ICLR,Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.4.1.1.1)\.
- \[11\]G\. Lee, W\. Yu, K\. Shin, W\. Cheng, and H\. Chen\(2025\)TimeCAP: learning to contextualize, augment, and predict time series events with large language model agents\.InProc\. AAAI,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p2.1)\.
- \[12\]Q\. Li, Z\. Zhang, L\. Yao, Z\. Li, T\. Zhong, and Y\. Zhang\(2025\)Diffusion\-based decoupled deterministic and uncertain framework for probabilistic multivariate time series forecasting\.InProc\. ICLR,Cited by:[§IV\-C](https://arxiv.org/html/2608.17164#S4.SS3.SSS0.Px3.p1.1)\.
- \[13\]Y\. Li, W\. Chen, X\. Hu, B\. Chen, B\. Sun, and M\. Zhou\(2024\)Transformer\-modulated diffusion models for probabilistic multivariate time series forecasting\.InProc\. ICLR,Cited by:[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.19.1.1.1)\.
- \[14\]Z\. Li, X\. Lin, Z\. Liu, J\. Zou, Z\. Wu, L\. Zheng, D\. Fu, Y\. Zhu, H\. F\. Hamann, H\. Tong, and J\. He\(2025\)Language in the flow of time: time\-series\-paired texts weaved into a unified temporal narrative\.CoRRabs/2502\.08942\.Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p2.1),[§I](https://arxiv.org/html/2608.17164#S1.p3.1),[§II](https://arxiv.org/html/2608.17164#S2.p2.1),[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.16.1.1.1)\.
- \[15\]H\. Liu, S\. Xu, Z\. Zhao, L\. Kong, H\. Kamarthi, A\. B\. Sasanur, M\. Sharma, J\. Cui, Q\. Wen, C\. Zhang, and B\. A\. Prakash\(2024\)Time\-mmd: multi\-domain multimodal dataset for time series analysis\.InProc\. NeurIPS,Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p2.1),[§I](https://arxiv.org/html/2608.17164#S1.p3.1),[§I](https://arxiv.org/html/2608.17164#S1.p7.1),[§II](https://arxiv.org/html/2608.17164#S2.p2.1),[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px1.p1.1),[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.17.1.1.1)\.
- \[16\]J\. Liu, L\. Yang, H\. Li, and S\. Hong\(2024\)Retrieval\-augmented diffusion models for time series forecasting\.InProc\. NeurIPS,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[17\]P\. Liu, H\. Guo, T\. Dai, N\. Li, J\. Bao, X\. Ren, Y\. Jiang, and S\. Xia\(2025\)CALF: aligning llms for time series forecasting via cross\-modal fine\-tuning\.InProc\. AAAI,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p1.1)\.
- \[18\]Y\. Liu, T\. Hu, H\. Zhang, H\. Wu, S\. Wang, L\. Ma, and M\. Long\(2024\)ITransformer: inverted transformers are effective for time series forecasting\.InProc\. ICLR,Cited by:[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.8.1.1.1)\.
- \[19\]Y\. Liu, G\. Qin, Z\. Shi, Z\. Chen, C\. Yang, X\. Huang, J\. Wang, and M\. Long\(2025\)Sundial: A family of highly capable time series foundation models\.InProc\. ICML,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[20\]Y\. Nie, N\. H\. Nguyen, P\. Sinthong, and J\. Kalagnanam\(2023\)A time series is worth 64 words: long\-term forecasting with transformers\.InProc\. ICLR,Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.7.1.1.1)\.
- \[21\]S\. Noroozizadeh, S\. Kumar, and J\. C\. Weiss\(2026\)Forecasting clinical risk from textual time series: structuring narratives for temporal AI in healthcare\.InProc\. AAAI,Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p1.1)\.
- \[22\]Z\. Pan, Y\. Jiang, S\. Garg, A\. Schneider, Y\. Nevmyvaka, and D\. Song\(2024\)S2IP\-LLM: semantic space informed prompt learning with LLM for time series forecasting\.InProc\. ICML,Cited by:[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.15.1.1.2)\.
- \[23\]K\. Rasul, C\. Seward, I\. Schuster, and R\. Vollgraf\(2021\)Autoregressive denoising diffusion models for multivariate probabilistic time series forecasting\.InProc\. ICML,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[24\]N\. Reimers and I\. Gurevych\(2019\)Sentence\-bert: sentence embeddings using siamese bert\-networks\.InProc\. EMNLP,Cited by:[§V\-C](https://arxiv.org/html/2608.17164#S5.SS3.SSS0.Px3.p1.1)\.
- \[25\]L\. Shen, W\. Chen, and J\. T\. Kwok\(2024\)Multi\-resolution diffusion models for time series forecasting\.InProc\. ICLR,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[26\]L\. Shen and J\. T\. Kwok\(2023\)Non\-autoregressive conditional diffusion models for time series prediction\.InProc\. ICML,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.21.1.1.1)\.
- \[27\]J\. Song, C\. Meng, and S\. Ermon\(2021\)Denoising diffusion implicit models\.InProc\. ICLR,Cited by:[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px5.p1.1)\.
- \[28\]C\. Su, Y\. Tian, and Y\. Song\(2025\)Multimodal conditioned diffusive time series forecasting\.CoRRabs/2504\.19669\.Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[29\]M\. Tan, M\. A\. Merrill, V\. Gupta, T\. Althoff, and T\. Hartvigsen\(2024\)Are language models actually useful for time series forecasting?\.InProc\. NeurIPS,Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.9.1.1.1)\.
- \[30\]Y\. Tashiro, J\. Song, Y\. Song, and S\. Ermon\(2021\)CSDI: conditional score\-based diffusion models for probabilistic time series imputation\.InProc\. NeurIPS,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1),[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.18.1.1.1)\.
- \[31\]N\. C\. Truong, J\. McInerney, L\. Tran\-Thanh, E\. Costanza, and S\. D\. Ramchurn\(2013\)Forecasting multi\-appliance usage for smart home energy management\.InProc\. IJCAI,Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p1.1)\.
- \[32\]C\. Wang, Q\. Qi, J\. Wang, H\. Sun, Z\. Zhuang, J\. Wu, L\. Zhang, and J\. Liao\(2025\)ChatTime: A unified multimodal time series foundation model bridging numerical and textual data\.InProc\. AAAI,Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p2.1),[§I](https://arxiv.org/html/2608.17164#S1.p3.1),[§II](https://arxiv.org/html/2608.17164#S2.p2.1)\.
- \[33\]H\. Wu, T\. Hu, Y\. Liu, H\. Zhou, J\. Wang, and M\. Long\(2023\)TimesNet: temporal 2d\-variation modeling for general time series analysis\.InProc\. ICLR,Cited by:[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1)\.
- \[34\]H\. Wu, J\. Xu, J\. Wang, and M\. Long\(2021\)Autoformer: decomposition transformers with auto\-correlation for long\-term series forecasting\.InProc\. NeurIPS,Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.5.1.1.1)\.
- \[35\]X\. Wu, J\. Jin, W\. Qiu, P\. Chen, Y\. Shu, B\. Yang, and C\. Guo\(2026\)Aurora: towards universal generative multimodal time series forecasting\.InProc\. ICLR,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[36\]Y\. Yao, J\. Li, X\. Dai, M\. Zhang, X\. Gong, F\. Wang, and Y\. Lv\(2025\)Context\-aware probabilistic modeling with LLM for multimodal time series forecasting\.CoRRabs/2505\.10774\.Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p2.1),[§I](https://arxiv.org/html/2608.17164#S1.p3.1)\.
- \[37\]W\. Ye, Z\. Xu, and N\. Gui\(2025\)Non\-stationary diffusion for probabilistic time series forecasting\.InProc\. ICML,Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.20.1.1.1)\.
- \[38\]A\. Zeng, M\. Chen, L\. Zhang, and Q\. Xu\(2023\)Are transformers effective for time series forecasting?\.InProc\. AAAI,Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.10.1.1.1)\.
- \[39\]D\. Zhang, B\. Li, Z\. Zhao, J\. Gao, F\. Nie, and X\. Li\(2025\)UniDiff: A unified diffusion framework for multimodal time series forecasting\.CoRRabs/2512\.07184\.Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p3.1)\.
- \[40\]X\. Zhang, Z\. Huang, Y\. Wu, X\. Lu, E\. Qi, Y\. Chen, Z\. Xue, Q\. Wang, P\. Wang, and W\. Wang\(2025\)Multi\-period learning for financial time series forecasting\.InProc\. KDD,Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p1.1)\.
- \[41\]L\. N\. Zheng, C\. G\. Dong, W\. E\. Zhang, L\. Yue, M\. Xu, O\. Maennel, and W\. Chen\(2025\)Understanding why large language models can be ineffective in time series analysis: the impact of modality alignment\.InProc\. KDD,Cited by:[§I](https://arxiv.org/html/2608.17164#S1.p3.1)\.
- \[42\]H\. Zhou, S\. Zhang, J\. Peng, S\. Zhang, J\. Li, H\. Xiong, and W\. Zhang\(2021\)Informer: beyond efficient transformer for long sequence time\-series forecasting\.InProc\. AAAI,Cited by:[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.3.1.1.1)\.
- \[43\]T\. Zhou, Z\. Ma, X\. Wang, Q\. Wen, L\. Sun, T\. Yao, W\. Yin, and R\. Jin\(2022\)FiLM: frequency improved legendre memory model for long\-term time series forecasting\.InProc\. NeurIPS,Cited by:[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.11.1.1.1)\.
- \[44\]T\. Zhou, Z\. Ma, Q\. Wen, X\. Wang, L\. Sun, and R\. Jin\(2022\)FEDformer: frequency enhanced decomposed transformer for long\-term series forecasting\.InProc\. ICML,Cited by:[§V\-A](https://arxiv.org/html/2608.17164#S5.SS1.SSS0.Px3.p1.1),[Table I](https://arxiv.org/html/2608.17164#S5.T1.19.6.1.1.1)\.
- \[45\]T\. Zhou, P\. Niu, X\. Wang, L\. Sun, and R\. Jin\(2023\)One fits all: power general time series analysis by pretrained LM\.InProc\. NeurIPS,Cited by:[§II](https://arxiv.org/html/2608.17164#S2.p1.1)\.Similar Articles
Differencing the Diffusion Trajectory toward Uncertain Components for Time Series Forecasting
This paper proposes DiffDiff, a diffusion framework for probabilistic time series forecasting that embeds predictability asymmetry into the diffusion trajectory, outperforming six diffusion baselines on seven benchmarks across four prediction horizons.
DynG-Diff: A State-Aware Dynamic Guidance Diffusion Framework for Probabilistic Time Series Forecasting
DynG-Diff proposes a state-aware dynamic guidance diffusion framework for probabilistic multivariate time series forecasting, improving robustness by adaptively handling variable heterogeneity.
MMDiff: Extending Diffusion Transformers for Multi-Modal Generation
MMDiff extends frozen diffusion transformers into multi-modal generative systems using lightweight decoders, achieving significant improvements in semantic segmentation and other perceptual tasks through multi-timestep feature fusion.
SevDiff: Severity-Conditioned Diffusion for Long-Tail Conflict Trajectory Generation
SevDiff is a severity-conditioned diffusion model for generating vehicle conflict trajectories with controlled time-to-collision values, achieving high hit-rate on a real-world dataset for ADAS evaluation.
Decision-Focused Scenario Generation and Selection for Efficient and Robust Grid Dispatch
This paper proposes a decision-focused generative framework for correlated scenario generation in distributionally robust optimization for grid dispatch, optimizing scenarios based on downstream operational cost rather than forecast accuracy. It reduces operational cost by 0.80–2.02% compared to accuracy-oriented methods across different generative models.