ReDiTT: Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series

# Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series
Source: [https://arxiv.org/html/2607.12391](https://arxiv.org/html/2607.12391)
Saiyue Lyusaiyue\.lyu@ubc\.ca Department of Computer Science, University of British ColumbiaZhitian Zhangandy\.zhang@rbc\.com RBC BorealisRuizhi Dengruizhi\.deng@borealisai\.com RBC BorealisThibaut Durandthibaut\.durand@borealisai\.com RBC Borealis

###### Abstract

We present a diffusion based model for asynchronous time series prediction, where the goal is to predict the next inter event time and event type\. To address the inherent uncertainty of future events, we introduce ReDiTT, a retrieval augmented conditional diffusion transformer that operates in latent space\. ReDiTT retrieves structurally similar latent sequences from a memory bank during both training and inference and incorporates them as reference conditions through cross attention\. This retrieval based conditioning allows the model to attend to relevant temporal dynamics and provides global structural guidance for generation\. As a result, ReDiTT stabilizes long horizon forecasting and improves sample diversity\. Experiments on seven real world datasets demonstrate state of the art performance on next event prediction and long horizon forecasting\. Our code is available at[https://github\.com/BorealisAI/ReDiTT](https://github.com/BorealisAI/ReDiTT)\.

## 1Introduction

Asynchronous time series \(a\.k\.a\.continuous\-time event sequence\) prediction arises in a wide range of real world applications, including event driven systems\(Enguehardet al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib8)\), healthcare monitoring\(Lorchet al\.,[2018](https://arxiv.org/html/2607.12391#bib.bib1); Rizoiuet al\.,[2018](https://arxiv.org/html/2607.12391#bib.bib2)\), finance\(Bacryet al\.,[2015](https://arxiv.org/html/2607.12391#bib.bib3); Jinet al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib4)\), and user behavior modeling\(Hernandezet al\.,[2017](https://arxiv.org/html/2607.12391#bib.bib7); Zhanget al\.,[2022](https://arxiv.org/html/2607.12391#bib.bib5); Konget al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib6)\), where observations occur at irregular time intervals rather than on a fixed grid\. Unlike regularly sampled time series, asynchronous data encodes information jointly in both event values and inter\-event times, leading to complex temporal dynamics that are highly stochastic and nonstationary\(Xueet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib11)\)\. Accurately modeling such data is crucial for downstream tasks such as forecasting, simulation, and decision making, yet remains challenging due to the sparsity, irregularity, and long\-range temporal dependencies inherent in these processes\(Schirmeret al\.,[2022](https://arxiv.org/html/2607.12391#bib.bib9); Zhanget al\.,[2024](https://arxiv.org/html/2607.12391#bib.bib10)\)\.

Asynchronous time series prediction is further complicated by the need to model uncertainty and multimodality over future events, particularly in long\-horizon forecasting\. Classical autoregressive and likelihood\-based temporal point process models often rely on strong parametric assumptions or Markovian dynamics\(Hawkes,[1971](https://arxiv.org/html/2607.12391#bib.bib12); Mei and Eisner,[2017](https://arxiv.org/html/2607.12391#bib.bib16); Zhanget al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib17); Zuoet al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib18); Yanget al\.,[2021](https://arxiv.org/html/2607.12391#bib.bib13)\), limiting their ability to generalize to more complex asynchronous time series, particularly those exhibiting rich global structure, long\-range dependencies, or mixed continuous and discrete observations\.

Recent progress has shown that generative modeling in latent space via variational autoencoders \(VAEs\)\(Higginset al\.,[2017](https://arxiv.org/html/2607.12391#bib.bib22)\)combined with diffusion models\(Peebles and Xie,[2023](https://arxiv.org/html/2607.12391#bib.bib23)\), can effectively capture the stochastic structure of asynchronous time series\. In particular,Mukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\)demonstrates that a VAE can learn a compact and expressive latent representation that supports both accurate reconstruction and diffusion\-based next\-event and long\-horizon forecasting\. While diffusion models are powerful generative models, their application to asynchronous time series remains underexplored, despite their ability to generate sequences holistically and mitigate error accumulation compared to autoregressive approaches\.

![Refer to caption](https://arxiv.org/html/2607.12391v1/pipeline.png)Figure 1:Overview of ReDiTT framework\. Given an observed event history, we retrieve the similar sequences from a token memory bank\. The retrieved references are injected into diffusion transformer to guide denoising for future forecasting\.Despite recent progress, unconditional or weakly conditional diffusion models still face significant challenges in long\-horizon time series prediction\(Liuet al\.,[2024](https://arxiv.org/html/2607.12391#bib.bib24)\)\. Unlike image diffusion models, time series data usually do not come with explicit semantic labels or other strong sources of supervision, which limits the availability of informative global conditioning signals during generation\. Without such guidance, the model has less ability to preserve the specific dynamics of an individual trajectory over extended horizons\. As a result, long\-term forecasts often drift toward generic, high\-probability patterns from the training distribution, rather than maintaining trajectory\-specific temporal structure and fine\-grained event evolution\.

To address these limitations, we proposeReDiTT:Retrieval Augmented ConditionalDiffusionTransformers for AsynchronousTime Series\. During training, each sequence retrieves its topkknearest neighbors from a token memory bank, which are then used as conditions\. These retrieved sequences share the same latent format as the input and are incorporated through cross\-attention modules within the diffusion transformer blocks, allowing the model to explicitly attend to structurally similar temporal dynamics\. At inference time, we retrieve the topkkreferences from the token memory bank built from training set to guide generation\. An overview of ReDiTT is illustrated in[Figure˜1](https://arxiv.org/html/2607.12391#S1.F1)\. This retrieval\-augmented conditioning provides global structural guidance that stabilizes long\-horizon forecasting, and improves sample diversity by anchoring generation to concrete examples of temporal dynamics rather than relying purely on learned parameters\. Our main contributions are:

- 1We introduce ReDiTT, the first retrieval\-based diffusion framework for asynchronous time series prediction that conditions on top\-kkretrieved latent priors from a pre\-constructed latent token bank\.
- 2We propose a novel conditioning approach for retrieve\-based diffusion transformer and show it effectively integrates prior information and provides reasonable guidance\.
- 3We demonstrate that ReDiTT significantly improves next\-event and long\-horizon prediction with state\-of\-the\-art performances by experiments on seven real world datasets with a comprehensive analysis\.

## 2Related Work

### 2\.1Temporal Point Processes \(TPPs\)

Marked TPPs are widely adopted as a standard approach for modeling asynchronous time series\. A TPP is a stochastic process that generates sequences of discrete events over time\. A sequence ofnnevents can be represented as𝐱=\{𝐱1,⋯,𝐱n\}\{\\mathbf\{x\}\}=\\\{\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{n\}\\\}, where each event𝐱i=\(ti,ei\)\{\\mathbf\{x\}\}\_\{i\}=\(t\_\{i\},e\_\{i\}\)consists of the indexiiindicating the chronological order of events, the inter\-event timetit\_\{i\}since the previous event and the corresponding event typeeie\_\{i\}\. Another widely used variant is to represent events by their inter\-event intervalsτi=ti−ti−1\\tau\_\{i\}=t\_\{i\}\-t\_\{i\-1\}rather than the absolute timestampstit\_\{i\}\. These two parameterizations are essentially equivalent, so the literature often switches between them without loss of generality\. Classical TPP models\(Mei and Eisner,[2017](https://arxiv.org/html/2607.12391#bib.bib16)\)parameterize conditional intensity functions for next\-event prediction and are trained by maximizing the log\-likelihood of observed event sequences\. Prior work on temporal point processes has largely focused on neural architectures that extend likelihood\-based intensity modeling, beginning with RNN\-based approaches\(Duet al\.,[2016](https://arxiv.org/html/2607.12391#bib.bib14); Mei and Eisner,[2017](https://arxiv.org/html/2607.12391#bib.bib16)\)and later incorporating more expressive designs to better capture uncertainty\(Mehrasaet al\.,[2019](https://arxiv.org/html/2607.12391#bib.bib15); Lüdkeet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib20)\)\. More recent Transformer\-based TPPs leverage attention mechanisms to improve long range dependency modeling\(Zhanget al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib17); Zuoet al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib18); Yanget al\.,[2021](https://arxiv.org/html/2607.12391#bib.bib13)\), but still rely on autoregressive intensity formulations\. However, the goal has extended beyond forecasting the immediate next event to generating the full future event trajectory, and classical and neural TPPs can be unsatisfactory since errors introduced at early steps accumulate as the autoregressive rollout proceeds\. On the optimization side, likelihood\-based training typically requires computing distributional quantities implied by the learned intensity, which can become expensive\.

### 2\.2Diffusion Models for Asynchronous Time Series

The shortcomings of classic neural TPP approaches motivate diffusion and flow matching approaches\. These methods treat forecasting as conditional generation, transforming simple base noise into future event sequences given the history\. By modeling the joint continuation rather than repeatedly sampling one event at a time, diffusion based approaches can better support long\-horizon generation and produces diverse futures for uncertainty quantification, offering a strong non\-autoregressive alternative to intensity\-based neural TPPs\. Early diffusion work in time series focused on learning conditional distributions for tasks like imputation\(Tashiroet al\.,[2021](https://arxiv.org/html/2607.12391#bib.bib26)\)and probabilistic forecasting\(Rasulet al\.,[2021](https://arxiv.org/html/2607.12391#bib.bib25)\), demonstrating that iterative denoising can capture uncertainty without being constrained to a single greedy rollout\. For temporal point processes specifically, Add and Thin\(Lüdkeet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib20)\)formulates diffusion over full marked event sequences and outperforms autoregressive TPP forecasters\.Zhouet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib28)\)embed event sequences into a vector space and diffuse to forecast the full future sequence in one go\.Yuanet al\.\([2023](https://arxiv.org/html/2607.12391#bib.bib27)\)extended diffusion to spatio\-temporal setting\.Zenget al\.\([2024](https://arxiv.org/html/2607.12391#bib.bib29)\)coupled two diffusions, one for inter\-arrival times and one for event types, to model the joint distribution\. More recently, ADiff4TPP\(Mukherjeeet al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib21)\)proposed an asynchronous noise schedule in a VAE latent space to strengthen conditioning via earlier event history when predicting further into the future\. While promising, these approaches yield only limited empirical gains, and diffusion for asynchronous event modeling is still relatively understudied\. We propose retrieval based diffusion transformers to tackle these challenges and better predict long\-horizon future\.

### 2\.3Retrieval Augmented Generation

Retrieval has become a practical way to enhance generative models with non\-parametric memory\. For text,kkNN language models\(Khandelwalet al\.,[2019](https://arxiv.org/html/2607.12391#bib.bib30)\)augment a base LM by retrieving semantically similar contexts from a data store at inference time\. For image, retrieval\-augmented diffusion models\(Blattmannet al\.,[2022](https://arxiv.org/html/2607.12391#bib.bib31)\)condition denoising on retrieved reference images to better capture specific visual structure and long\-tail concepts\. In time series forecasting, several recent methods\(Hanet al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib32); Ninget al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib33); Tireet al\.,[2024](https://arxiv.org/html/2607.12391#bib.bib34); Li,[2025](https://arxiv.org/html/2607.12391#bib.bib35)\)leverage retrieval by selecting historically similar segments and using their continuations as additional context\. RATD\(Liuet al\.,[2024](https://arxiv.org/html/2607.12391#bib.bib24)\)further combines retrieval with diffusion by injecting retrieved references into the denoising process\. However, these approaches are primarily designed for regularly sampled time series segments and do not directly apply to asynchronous marked event streams without nontrivial changes\. In contrast, our method is tailored to event prediction: we perform retrieval in a VAE latent space that preserves event wise structure, and condition a latent diffusion transformer on retrieved references represented in the same event\-sequence format\. This design enables trajectory\-specific guidance for coherent long horizon event generation, rather than serving only as a segment level short range forecasting booster\.

## 3Preliminary

### 3\.1Asynchronous Time Series Forecasting Tasks

Asynchronous time series forecasting is typically evaluated using two tasks\. Suppose we observe an event history\{𝐱1,⋯,𝐱i\}\\\{\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{i\}\\\}\.Next event predictionrequires a model to forecast the immediate next event𝐱^i\+1=\(t^i\+1,e^i\+1\\hat\{\\mathbf\{x\}\}\_\{i\+1\}=\(\\hat\{t\}\_\{i\+1\},\\hat\{e\}\_\{i\+1\}\), including both its occurrence time or inter\-arrival time and its type or mark, conditioned on the observed history\.Long horizon predictionextends this setting by requiring the model to generate a sequence of future events\{𝐱^i\+1,⋯,𝐱^i\+m\}\\\{\\hat\{\\mathbf\{x\}\}\_\{i\+1\},\\cdots,\\hat\{\\mathbf\{x\}\}\_\{i\+m\}\\\}over a prediction window of lengthmm\. This task evaluates the model’s ability to capture how uncertainty accumulates as the forecasting horizon increases\.

### 3\.2Flow Matching for Asynchronous Time Series

Flow matching \(FM\)\(Lipmanet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib36); Liuet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib37); Leeet al\.,[2024](https://arxiv.org/html/2607.12391#bib.bib38); Esseret al\.,[2024](https://arxiv.org/html/2607.12391#bib.bib39)\)provides a diffusion style way to train continuous time generative models by directly regressing a velocity field instead of learning scores\. Concretely, FM views the generation as solving an ODE that transports a simple base distribution \(typically Gaussian noise\) to the data distribution via a learned vector fieldd​𝐳sd​s=vθ​\(𝐳s,s\)\\frac\{d\{\\mathbf\{z\}\}\_\{s\}\}\{ds\}=v\_\{\\theta\}\(\{\\mathbf\{z\}\}\_\{s\},s\), using an explicit interpolation path𝐳s=as​𝐳\+bs​ϵ\{\\mathbf\{z\}\}\_\{s\}=a\_\{s\}\{\\mathbf\{z\}\}\+b\_\{s\}\\bm\{\\epsilon\}, wheressdenotes a random times∼𝒰​\(0,1\)s\\sim\\mathcal\{U\}\(0,1\)\(we usessto denote the timestep in diffusion model, andttto represent the time value for asynchronous time series data\),𝐳\{\\mathbf\{z\}\}is the input clean sample, andϵ∼𝒩​\(0,1\)\\bm\{\\epsilon\}\\sim\\mathcal\{N\}\(0,1\)is the Gaussian noise\. Rectified flow\(Liuet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib37); Leeet al\.,[2024](https://arxiv.org/html/2607.12391#bib.bib38)\)defines a simpler interpolation𝐳s=\(1−s\)​𝐳\+s​ϵ\{\\mathbf\{z\}\}\_\{s\}=\(1\-s\)\{\\mathbf\{z\}\}\+s\\bm\{\\epsilon\}\. Conditional Flow Matching \(CFM\) makes training simulation\-free by deriving a direct closed\-form conditional vector fieldus​\(𝐳s\|ϵ\)u\_\{s\}\(\{\\mathbf\{z\}\}\_\{s\}\|\\bm\{\\epsilon\}\)for this path, and learningvθv\_\{\\theta\}by a simple regression loss𝔼s,ϵ,𝐳\[∥vθ\(𝐳s,s\)−us\(𝐳s\|ϵ\)∥2\]\\mathbb\{E\}\_\{s,\\bm\{\\epsilon\},\{\\mathbf\{z\}\}\}\\big\[\\\|v\_\{\\theta\}\(\{\\mathbf\{z\}\}\_\{s\},s\)\-u\_\{s\}\(\{\\mathbf\{z\}\}\_\{s\}\|\\bm\{\\epsilon\}\)\\\|^\{2\}\\big\]\.

To facilitate efficient retrieval and ease the diffusion training, each event𝐱i\{\\mathbf\{x\}\}\_\{i\}is encoded as a compact latent representation𝐳i∈ℝd\{\\mathbf\{z\}\}\_\{i\}\\in\\mathbb\{R\}^\{d\}using a pretrained VAEEϕE\_\{\\phi\}\. Let𝐱∈𝒳\{\\mathbf\{x\}\}\\in\\mathcal\{X\}be an event sequence of lengthnn\. We pad𝐱\{\\mathbf\{x\}\}to a fixed lengthNN, whereNNis the maximum sequence length in𝒳\\mathcal\{X\}\. The encoder then maps the padded sequence to a latent representation𝐳=Eϕ​\(𝐱\)∈ℝN×d\{\\mathbf\{z\}\}=E\_\{\\phi\}\(\{\\mathbf\{x\}\}\)\\in\\mathbb\{R\}^\{N\\times d\}, which serves as a single training sample for latent flow matching\.

To make flow matching respect the causal and unevenly spaced nature of event sequences, asynchronous matrix valued interpolation\(Mukherjeeet al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib21)\)defines:

𝐳s=𝑨​\(s\)​𝐳\+\(𝑰−𝑨​\(s\)\)​ϵ,\{\\mathbf\{z\}\}\_\{s\}=\{\\bm\{A\}\}\(s\)\{\\mathbf\{z\}\}\+\(\{\\bm\{I\}\}\-\{\\bm\{A\}\}\(s\)\)\\bm\{\\epsilon\},\(1\)whereϵ=\{ϵ1,⋯,ϵN\}\\epsilon=\\\{\\epsilon\_\{1\},\\cdots,\\epsilon\_\{N\}\\\}is a Gaussian noise of same dimensionN×dN\\times das𝐳\{\\mathbf\{z\}\}\. And𝑨​\(s\)∈ℝN×N\{\\bm\{A\}\}\(s\)\\in\\mathbb\{R\}^\{N\\times N\}is a diagonal matrix whose per event schedule is designed so that later events are injected with noise earlier \(and therefore are trained to be denoised earlier\) than earlier events, that being said, later events are corrupted earlier and the model learns to denoise and forecast the tail under stronger noise\.

This yields a generative ODE that incorporates the schedule derivative with the chain rule:

d​𝐳sd​s=𝑨′​\(s\)​vθ​\(𝐳s,𝑨​\(s\)\)\.\\frac\{d\{\\mathbf\{z\}\}\_\{s\}\}\{ds\}=\{\\bm\{A\}\}^\{\\prime\}\(s\)v\_\{\\theta\}\(\{\\mathbf\{z\}\}\_\{s\},\{\\bm\{A\}\}\(s\)\)\.\(2\)In each training iteration, we randomly select a times∈\[0,1\]s\\in\[0,1\]and generate the corresponding intermediate state𝐳s\{\\mathbf\{z\}\}\_\{s\}using[Equation˜1](https://arxiv.org/html/2607.12391#S3.E1)\. Training follows a CFM objective in this asynchronous setting by weighting the regression with𝑨′​\(s\)\{\\bm\{A\}\}^\{\\prime\}\(s\):

ℒCFM\(θ\)=𝔼s,ϵ,𝐳\[∥𝑨′\(s\)\(vθ\(𝐳s,𝑨\(s\)\)−us\(𝐳s\|ϵ\)\)∥2\]\.\\mathcal\{L\}\_\{\\text\{CFM\}\}\(\\theta\)=\\mathbb\{E\}\_\{s,\\bm\{\\epsilon\},\{\\mathbf\{z\}\}\}\\big\[\\,\\,\\\|\{\\bm\{A\}\}^\{\\prime\}\(s\)\\big\(\\,v\_\{\\theta\}\(\{\\mathbf\{z\}\}\_\{s\},\{\\bm\{A\}\}\(s\)\)\-u\_\{s\}\(\{\\mathbf\{z\}\}\_\{s\}\|\\bm\{\\epsilon\}\)\\,\\big\)\\\|^\{2\}\\,\\,\\big\]\.\(3\)
During inference, given a observed history𝐱1,⋯,𝐱n\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{n\}and a target prediction horizon sizemm\. We can form a initial condition\{𝐳1,⋯,𝐳n,ϵn\+1,⋯,ϵn\+m\}\\\{\{\\mathbf\{z\}\}\_\{1\},\\cdots,\{\\mathbf\{z\}\}\_\{n\},\\epsilon\_\{n\+1\},\\cdots,\\epsilon\_\{n\+m\}\\\}and we can incorporate the history by filling the corresponding entries ofd​𝐳sd​s\\frac\{d\{\\mathbf\{z\}\}\_\{s\}\}\{ds\}in[Equation˜2](https://arxiv.org/html/2607.12391#S3.E2)with the known latents:

d​𝐳sd​s=\{𝑨′​\(s\)i​i​\(𝐳i−ϵi\)if​1≤i≤n,𝑨′​\(s\)i​i​vθ​\(𝐳s,𝑨​\(s\)\)if​n<i≤n\+m\.\\frac\{d\{\\mathbf\{z\}\}\_\{s\}\}\{ds\}=\\begin\{cases\}\{\\bm\{A\}\}^\{\\prime\}\(s\)\_\{ii\}\(\{\\mathbf\{z\}\}\_\{i\}\-\\epsilon\_\{i\}\)&\\text\{if \}1\\leq i\\leq n,\\\\ \{\\bm\{A\}\}^\{\\prime\}\(s\)\_\{ii\}v\_\{\\theta\}\(\{\\mathbf\{z\}\}\_\{s\},\{\\bm\{A\}\}\(s\)\)&\\text\{if \}n<i\\leq n\+m\.\\end\{cases\}\(4\)Standard ODE solvers can solve this without introducing numerical error, which leads us to the predictions\{𝐳^n\+1,⋯,𝐳^n\+m\}\\\{\\hat\{\\mathbf\{z\}\}\_\{n\+1\},\\cdots,\\hat\{\\mathbf\{z\}\}\_\{n\+m\}\\\}\. The decoder then maps them back to the original space to obtain\{𝐱^n,⋯,𝐱^n\+m\}\\\{\\hat\{\\mathbf\{x\}\}\_\{n\},\\cdots,\\hat\{\\mathbf\{x\}\}\_\{n\+m\}\\\}\.

![Refer to caption](https://arxiv.org/html/2607.12391v1/ReDiTT.png)Figure 2:ReDiTTmodels long horizon asynchronous time series forecasting as conditional generation guided by retrieved references\. During training, we encode each event sequence𝐱train\{\\mathbf\{x\}\}\_\{\\text\{train\}\}into latent tokens𝐳train\{\\mathbf\{z\}\}\_\{\\text\{train\}\}and build a latent reference bankℬ\\mathcal\{B\}\. For each sample, we retrieve the top\-kknearest neighborsRRby latent similarity, aggregate them, and condition a DiT via cross\-attention\. We then train with the diffusion objective on the future latent segment to denoise and reconstruct clean latents given the prefix and retrieved context\. During inference, we encode the observed prefix𝐱test=\(t1,e1\),…,\(ti,ei\)\{\\mathbf\{x\}\}\_\{\\text\{test\}\}=\{\(t\_\{1\},e\_\{1\}\),\\ldots,\(t\_\{i\},e\_\{i\}\)\}, apply the same retrieval and aggregation, run the reverse diffusion process to sample future latents, and decode them into event times and types\(t^i\+1,e^i\+1\),⋯,\(t^i\+m,e^i\+m\)\(\\hat\{t\}\_\{i\+1\},\\hat\{e\}\_\{i\+1\}\),\\cdots,\(\\hat\{t\}\_\{i\+m\},\\hat\{e\}\_\{i\+m\}\)\.

## 4Method

To better ground diffusion\-based generation in trajectory\-specific dynamics, we propose ReDiTT, a retrieval augmented latent Diffusion Transformer for temporal point processes, as illustrated in[Figure˜2](https://arxiv.org/html/2607.12391#S3.F2)\. Given an observed event history\{𝐱1,⋯,𝐱i\}\\\{\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{i\}\\\}as input, our model generates a future event sequence\{𝐱^i\+1,⋯,𝐱^i\+m\}\\\{\\hat\{\\mathbf\{x\}\}\_\{i\+1\},\\cdots,\\hat\{\\mathbf\{x\}\}\_\{i\+m\}\\\}, supporting both next event prediction \(m=1m=1\) and long horizon prediction \(m\>1m\>1\)\. ReDiTT couples latent space embedding retrieval with conditional generation: we retrieve the top\-kkmost similar historical trajectories from a reference bank and use them as additional conditioning to guide the diffusion model towards context consistent futures\. We first describe our latent space retrieval strategy in[Section˜4\.1](https://arxiv.org/html/2607.12391#S4.SS1)\. We then introduce the reference guided conditional flow matching objective in[Section˜4\.2](https://arxiv.org/html/2607.12391#S4.SS2)\. Finally, we detail the conditional DiT architecture that integrates retrieved references via cross\-attention in[Section˜4\.3](https://arxiv.org/html/2607.12391#S4.SS3)\.

### 4\.1Masked Token Level Retrieval in Latent Space

Directly retrieving asynchronous sequences in the original observation space requires a carefully designed similarity function: each sequence mixes continuous inter\-event times with discrete event types, has variable length with padding, and may admit multiple plausible alignments, such as shifted temporal patterns or local event reorderings\. Consequently, naive raw\-space distances, such as Euclidean distance over concatenated padded features, can be dominated by scale mismatch, sparsity, or padding artifacts, and may not reflect trajectory\-level similarity\. We therefore perform retrieval in the latent space of the pretrained VAEEϕE\_\{\\phi\}, where each event𝐱i=\(ti,ei\)\{\\mathbf\{x\}\}\_\{i\}=\(t\_\{i\},e\_\{i\}\)is mapped to a compact representation𝐳i∈ℝd\{\\mathbf\{z\}\}\_\{i\}\\in\\mathbb\{R\}^\{d\}that is optimized to preserve the information needed for sequence reconstruction\. This choice is primarily motivated by representation alignment with the downstream generative model\. Since ReDiTT performs diffusion and conditioning over event\-sequence latents, latent\-space retrieval allows the model to consume retrieved references in the same space as the generation target, without requiring an additional hand\-designed metric over mixed continuous\-discrete observations\. Our raw\-space retrieval ablation in[Section˜D\.1](https://arxiv.org/html/2607.12391#A4.SS1)shows that carefully normalized raw similarities can also provide useful neighbors, indicating that retrieval\-augmented conditioning is robust to the retrieval representation\. Nevertheless, latent retrieval offers a simple and model\-aligned way to obtain reference trajectories for coherent multi\-event forecasting\.

Consider an asynchronous sequence𝐱=\{𝐱1,⋯,𝐱N\}\{\\mathbf\{x\}\}=\\\{\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{N\}\\\}with a padding mask𝐦∈\{0,1\}N\{\\mathbf\{m\}\}\\in\\\{0,1\\\}^\{N\}\(this mask is common in data processing to keep a constant total event length among all the sequence\), we useEϕE\_\{\\phi\}to produce per\-event latent tokens𝐳=Eϕ​\(𝐱\)∈ℝN×d\{\\mathbf\{z\}\}=E\_\{\\phi\}\(\{\\mathbf\{x\}\}\)\\in\\mathbb\{R\}^\{N\\times d\}\. In addition, we precompute a latent token bankℬ=\{\(𝐳=Eϕ​\(𝐱\),𝐦\)\|𝐱∈𝒳train\}\\mathcal\{B\}=\\\{\(\{\\mathbf\{z\}\}=E\_\{\\phi\}\(\{\\mathbf\{x\}\}\),\{\\mathbf\{m\}\}\)\|\\,\{\\mathbf\{x\}\}\\in\\mathcal\{X\}\_\{\\text\{train\}\}\\\}for the training database\. We then define a masked cosine similarity between a query\(q,𝐦q\)∈Eϕ​\(𝒳\)\(\\textbf\{q\},\{\\mathbf\{m\}\}^\{q\}\)\\in E\_\{\\phi\}\(\\mathcal\{X\}\)and a reference candidate\(𝐫,𝐦r\)∈ℬ\(\{\\mathbf\{r\}\},\{\\mathbf\{m\}\}^\{r\}\)\\in\\mathcal\{B\}as a token\-wise cosine averaged over valid time steps:

sim​\(q,𝐫\)=1∑i𝟏​\[𝐦iq∧𝐦ir\]​∑i:𝐦iq∧𝐦ir⟨qi,𝐫i⟩‖qi‖​‖𝐫i‖,\\texttt\{sim\}\(\\textbf\{q\},\{\\mathbf\{r\}\}\)=\\frac\{1\}\{\\sum\_\{i\}\\mathbf\{1\}\[\{\\mathbf\{m\}\}\_\{i\}^\{q\}\\wedge\{\\mathbf\{m\}\}\_\{i\}^\{r\}\]\}\\sum\_\{i:\{\\mathbf\{m\}\}\_\{i\}^\{q\}\\wedge\{\\mathbf\{m\}\}\_\{i\}^\{r\}\}\\frac\{\\langle\\textbf\{q\}\_\{i\},\{\\mathbf\{r\}\}\_\{i\}\\rangle\}\{\\\|\{\\textbf\{q\}\}\_\{i\}\\\|\\\|\{\\mathbf\{r\}\}\_\{i\}\\\|\},\(5\)whereq‖q‖2,𝐫‖𝐫‖2\\frac\{\\textbf\{q\}\}\{\\\|\\textbf\{q\}\\\|\_\{2\}\},\\frac\{\{\\mathbf\{r\}\}\}\{\\\|\{\\mathbf\{r\}\}\\\|\_\{2\}\}areℓ2\\ell\_\{2\}normalized tokens\. Finally, we retrieve the topkkreferences forq:

R​\(q\)=\{𝐫\|TopKr∈ℬ​sim​\(q,𝐫\),𝐫≠q\},R\(\\textbf\{q\}\)=\\\{\{\\mathbf\{r\}\}\\,\|\\,\\text\{TopK\}\_\{r\\in\\mathcal\{B\}\}\\,\\texttt\{sim\}\(\\textbf\{q\},\{\\mathbf\{r\}\}\),\{\\mathbf\{r\}\}\\neq\\textbf\{q\}\\\},\(6\)which will enter the diffusion process as extra condition\. During training, the query sequence is part of the training reference bank, so its nearest neighbor is typically the query sampleqitself and would dominate the conditioning signal\. Including this exact match would create a degenerate conditioning signal, allowing the model to rely on a duplicate of the input rather than learning to use informative neighboring trajectories\. We therefore exclude the closest reference during training and retrieve from the second closest neighbor onward\. At inference time, the query comes from the validation or test set while the reference bank contains only training sequences, so the top retrieved neighbor is not an exact duplicate of the query and can be safely used for conditioning\.

During evaluation, retrieval follows the natural forecasting setup used for all baselines: only the observed prefix is available when predicting future events\. Accordingly, before computing retrieval similarity, we mask all target/future positions in the query sequence and perform retrieval using only the observed prefix\. The retrieved sequence itself may contain its full continuation, but it is selected without access to the query’s future events\. To further examine the effect of this prefix\-only retrieval protocol, we include an additional retrieval\-only analysis in[Section˜C\.2](https://arxiv.org/html/2607.12391#A3.SS2)\. The results show that prefix\-only retrieval remains competitive with full\-sequence retrieval on most datasets, indicating that the observed prefix is generally sufficient to retrieve useful neighboring trajectories\.

### 4\.2Conditional Flow Matching with Retrieved References

LetRRdenote the external reference condition associated with a target latent event sequence𝐳\{\\mathbf\{z\}\}\. Conditioning does not alter the flow matching construction and[Equation˜1](https://arxiv.org/html/2607.12391#S3.E1)still holds, but we now learn a conditional vector fieldvθ\(⋅\|R\)v\_\{\\theta\}\(\\,\\cdot\\,\|\\,R\)that transports samples along this path while being guided byRR\. The conditional flow matching objective becomes:

ℒCFM\(θ\)=𝔼s,ϵ,𝐳\[∥𝑨′\(s\)\(vθ\(𝐳s,𝑨\(s\)\|R\)−us\(𝐳s\|ϵ\)\)∥2\]\.\\mathcal\{L\}\_\{\\text\{CFM\}\}\(\\theta\)=\\mathbb\{E\}\_\{s,\\bm\{\\epsilon\},\{\\mathbf\{z\}\}\}\\big\[\\,\\,\\\|\{\\bm\{A\}\}^\{\\prime\}\(s\)\\big\(\\,v\_\{\\theta\}\(\{\\mathbf\{z\}\}\_\{s\},\{\\bm\{A\}\}\(s\)\\,\|\\,R\)\-u\_\{s\}\(\{\\mathbf\{z\}\}\_\{s\}\|\\bm\{\\epsilon\}\)\\,\\big\)\\\|^\{2\}\\,\\,\\big\]\.\(7\)Intuitively,RRdoes not modify the geometry of the bridge fromϵ\\bm\{\\epsilon\}to𝐳\{\\mathbf\{z\}\}, but it provides additional information that biases the learned dynamics toward trajectory\-consistent solutions, which is especially helpful for long\-horizon generation\.

During training, we retrievekkreferencesRRfrom the same training bankℬ\\mathcal\{B\}and feed the latent tokens as an addition condition in every DiT block, encouraging the conditional flow to model a set of plausible futures consistent with similar historical trajectories\. During inference, we retrieve from the same training bank again , so the sequences that model has already encountered can serve as an in\-distribution prototype that stabilizes long\-horizon generation and reduces drift when extrapolating far beyond the local context\.

### 4\.3Conditional Diffusion Transformer Architecture

We modify the Transformer based DiT blocks because they have the following issues when applying to asynchronous time series: conditioning is often injected through adaptive normalization \(e\.g\., AdaLN\) where a global conditioning vector \(typically built from the diffusion timestep and a sparse label\) modulates each block\. For asynchronous sequences, this kind of conditioning is intrinsically limited: the timestep carries no instance\-specific semantics, and event “labels” \(if any\) are usually coarse or unavailable, so the conditioning signal is weak and globally broadcast to all tokens in the same way\.

After retrievingkknearest\-neighbor reference sequences in latent space, we therefore construct a sequence\-shaped condition that mirrors the input format\. Say we have retrieveR=\{𝐫j\}j=1kR=\\\{\{\\mathbf\{r\}\}^\{j\}\\\}\_\{j=1\}^\{k\}for input latent𝐳\{\\mathbf\{z\}\}, we first obtain a reference sequence by weighted pooling:

𝐫=∑j=1kwj​𝐫j∈ℝN×d,wj=softmax​\(sim​\(𝐳,𝐫j\)\)\.\{\\mathbf\{r\}\}=\\sum\_\{j=1\}^\{k\}w\_\{j\}\{\\mathbf\{r\}\}^\{j\}\\in\\mathbb\{R\}^\{N\\times d\},\\,\\,w\_\{j\}=\\texttt\{softmax\}\\big\(\\texttt\{sim\}\(\{\\mathbf\{z\}\},\{\\mathbf\{r\}\}^\{j\}\)\\big\)\.\(8\)
Before entering the DiT blocks, both current latent input and retrieved reference are expanded to hidden sizeDDby channel repetition, for𝐫\{\\mathbf\{r\}\}, we also broadcast the mask𝐦𝐳\{\\mathbf\{m\}\}^\{\{\\mathbf\{z\}\}\}across the channel dimension\. Then𝐳\{\\mathbf\{z\}\}and𝐫\{\\mathbf\{r\}\}are augmented with fixed positional embeddingsposto get𝐳=Repeat​\(𝐳\)\+pos𝐳∈ℝN×D\{\\mathbf\{z\}\}=\\texttt\{Repeat\}\(\{\\mathbf\{z\}\}\)\+\\texttt\{pos\}\_\{\{\\mathbf\{z\}\}\}\\in\\mathbb\{R\}^\{N\\times D\}and𝐫=Repeat​\(𝐫\)\+pos𝐫∈ℝN×D\{\\mathbf\{r\}\}=\\texttt\{Repeat\}\(\{\\mathbf\{r\}\}\)\+\\texttt\{pos\}\_\{\{\\mathbf\{r\}\}\}\\in\\mathbb\{R\}^\{N\\times D\}\. Considering the reference has the same format as the input, it is naturally to inject𝐫\{\\mathbf\{r\}\}via cross\-attention after self attention in each DiT block as illustrated in[Figure˜2](https://arxiv.org/html/2607.12391#S3.F2)\. After the LayerNorm, the module forms:

𝑸=𝑾q​\(LN​\(𝐳\)\),𝑲=𝑾k​\(LN​\(𝐫\)\),𝑽=𝑾v​\(LN​\(𝐫\)\),\{\\bm\{Q\}\}=\{\\bm\{W\}\}\_\{q\}\(\\textbf\{LN\}\(\{\\mathbf\{z\}\}\)\),\\,\\,\{\\bm\{K\}\}=\{\\bm\{W\}\}\_\{k\}\(\\textbf\{LN\}\(\{\\mathbf\{r\}\}\)\),\\,\\,\{\\bm\{V\}\}=\{\\bm\{W\}\}\_\{v\}\(\\textbf\{LN\}\(\{\\mathbf\{r\}\}\)\),\(9\)splits intoα\\alphaheads, and computes masked attention weights over the flattened memory positions:

Attn=MaskedSoftmax​\(𝑸​𝑲⊺D/α;𝐦r\)\.\\textbf\{Attn\}=\\texttt\{MaskedSoftmax\}\(\\frac\{\{\\bm\{Q\}\}\{\\bm\{K\}\}^\{\\intercal\}\}\{\\sqrt\{D/\\alpha\}\};\{\\mathbf\{m\}\}^\{r\}\)\.\(10\)
The attention output is𝒀=Attn​𝑽\{\\bm\{Y\}\}=\\textbf\{Attn\}\{\\bm\{V\}\}, followed by an output projection𝑾out\{\\bm\{W\}\}\_\{\\text\{out\}\}and a learned scalar sigmoid gatec∈ℝc\\in\\mathbb\{R\}:

𝐳=𝐳\+σ​\(c\)​𝑾out​𝒀\.\{\\mathbf\{z\}\}=\{\\mathbf\{z\}\}\+\\sigma\(c\)\{\\bm\{W\}\}\_\{\\text\{out\}\}\{\\bm\{Y\}\}\.\(11\)
Our cross\-attention conditioning is effective as it injects the retrieved reference as a token level external memory, letting each latent token selectively attend to the most relevant reference positions rather than relying on a coarse global conditioning vector\. The sigmoid gated residual makes this guidance stable and adaptive, i\.e\. starting weak and strengthening only when it improves generation, so the model can leverage retrieval without overwhelming the base dynamics\. More details are discussed in Appendix[Section˜B\.3](https://arxiv.org/html/2607.12391#A2.SS3)\.

## 5Experiments

### 5\.1Experimental Setup

Datasets\.FollowingXueet al\.\([2023](https://arxiv.org/html/2607.12391#bib.bib11)\), we run experiments on five standard temporal point process datasets: Amazon\(Niet al\.,[2019](https://arxiv.org/html/2607.12391#bib.bib40)\)with 16 event types; Retweet\(Zhouet al\.,[2013](https://arxiv.org/html/2607.12391#bib.bib41)\)with 3 event types; StackOverflow\(Leskovec and Krevl,[2014](https://arxiv.org/html/2607.12391#bib.bib42)\)with 22 event types; Taobao\(Xueet al\.,[2022](https://arxiv.org/html/2607.12391#bib.bib43)\)with 20 event types; Taxi\(Whong,[2014](https://arxiv.org/html/2607.12391#bib.bib44)\)with 10 event types\. We also evaluate ReDiTT on two action datasets: Breakfast\(Kuehneet al\.,[2014](https://arxiv.org/html/2607.12391#bib.bib45)\)with 177 action classes, we scale the timestamp by dividing by 100 to avoid VAE training loss explosion; Multithumos\(Yeunget al\.,[2018](https://arxiv.org/html/2607.12391#bib.bib46)\)with 65 action classes, we take the 212 sequences with length≤\\leq100 out of total 289 sequences to avoid model ran out of memory\. More details are in Appendix[Section˜B\.1](https://arxiv.org/html/2607.12391#A2.SS1)and[Table˜6](https://arxiv.org/html/2607.12391#A2.T6)\.

Baselines\.We compare ReDiTT with four kinds of state\-of\-the\-art TPP models for asynchronous time series:1RNN\-based models, including RMTPP\(Duet al\.,[2016](https://arxiv.org/html/2607.12391#bib.bib14)\)and NHP\(Mei and Eisner,[2017](https://arxiv.org/html/2607.12391#bib.bib16)\);2Attention\-based models, including SAHP\(Zhanget al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib17)\), THP\(Zuoet al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib18)\), AttNHP\(Yanget al\.,[2021](https://arxiv.org/html/2607.12391#bib.bib13)\), and DTPP\(Panos,[2024](https://arxiv.org/html/2607.12391#bib.bib48)\);3Diffusion\-based models, including Add&Thin\(Lüdkeet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib20)\)and ADiff4TPP\(Mukherjeeet al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib21)\);4Other popular models including IFTPP\(Shchuret al\.,[2020](https://arxiv.org/html/2607.12391#bib.bib19)\)and HYPRO\(Xueet al\.,[2022](https://arxiv.org/html/2607.12391#bib.bib43)\)\.

Metrics\.FollowingXueet al\.\([2023](https://arxiv.org/html/2607.12391#bib.bib11)\), we examine our models on next event prediction\. We evaluate the time prediction by root mean square error \(RMSE\) between predicted time and true time, and the event type prediction by accuracy between predicted type and true type\. Note to compute the accumulated RMSE and accuracy, when predicting𝐱^i\+2\\hat\{\\mathbf\{x\}\}\_\{i\+2\}, the model uses the true history\{𝐱1,⋯,𝐱i,𝐱i\+1\}\\\{\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{i\},\{\\mathbf\{x\}\}\_\{i\+1\}\\\}rather than a previously predicted event\{𝐱1,⋯,𝐱i,𝐱^i\+1\}\\\{\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{i\},\\hat\{\\mathbf\{x\}\}\_\{i\+1\}\\\}\. We also examine ReDiTT on long\-horizon prediction by computing the optimal transport distance \(OTD\), a measurement of edit distance between the predicted\{𝐱^i\+1,⋯,𝐱^i\+m\}\\\{\\hat\{\\mathbf\{x\}\}\_\{i\+1\},\\cdots,\\hat\{\\mathbf\{x\}\}\_\{i\+m\}\\\}and the ground truth\{𝐱i\+1,⋯,𝐱i\+m\}\\\{\{\\mathbf\{x\}\}\_\{i\+1\},\\cdots,\{\\mathbf\{x\}\}\_\{i\+m\}\\\}\. We follow the implementation of OTD byMeiet al\.\([2019](https://arxiv.org/html/2607.12391#bib.bib47)\)with dynamic programming to efficiently find alignment and compute distance between predictions and true events\. FollowingMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\), we compute the OTD with horizon window sizem=5,10,20,30m=5,10,20,30respectively\.

To facilitate reproducibility, we provide full implementation details and hyperparameter settings in Appendix[Appendix˜B](https://arxiv.org/html/2607.12391#A2)\.

### 5\.2Next\-event Prediction and Long Horizon Prediction

Table 1:Next\-event prediction and long\-horizon prediction resultsfor ReDiTT and existing baselines on seven benchmark datasets\. RMSE is computed on the predicted inter\-event time, while Accuracy \(↑\\uparrow\) is computed on the predicted event type\. Long\-horizon forecasting performance is measured by OTD \(↓\\downarrow\) at horizonsm=5,10,20,30m=5,10,20,30\. We use ADiff4TPP as the unconditional diffusion baseline and include additional baselines provided byXueet al\.\([2023](https://arxiv.org/html/2607.12391#bib.bib11)\)\. When available, we report the results published inMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\)for direct comparison\. Thebest resultsare highlighted in bold, and thesecond best resultsare underlined\. Thenumbers in greywithin parentheses indicate the standard deviation with three random seeds 1,2,3\.In this section, we evaluate our model against existing methods on next\-event prediction and long\-horizon prediction tasks\. Overall,ReDiTT outperforms existing baselines on both tasks and is particularly effective in regimes with long event sequences and limited training samples, where purely parametric models struggle to capture rare transitions and long\-range temporal dependencies\. By retrieving trajectory\-level neighbors as explicit context, ReDiTT provides strong guidance for coherent long\-horizon generation under sparse supervision\. Beyond retrieval itself, the results demonstrate that the manner in which retrieved information is injected into the model is critical\. The proposed conditioning strategy, based on cross attention in diffusion transformers, enables the denoising network to selectively attend to the most relevant retrieved context, resulting in more accurate and coherent predictions\.

#### Next\-event prediction\.

[Section˜5\.2](https://arxiv.org/html/2607.12391#S5.SS2)summarizes the main results on seven benchmark datasets\. Performance is evaluated on next\-event prediction, using RMSE for time prediction and accuracy for type prediction\. Overall, ReDiTT exhibits the strongest and most consistent performance across a broad range of dynamics\. It achieves the best RMSE and the highest type accuracy on all datasets\. ReDiTT substantially outperforms both classic neural TPP baselines and recent diffusion\-based or flow\-based forecasters\. In addition, ReDiTT delivers large gains in average performance across datasets compared to the strongest baseline, ADiff4TPP\(Mukherjeeet al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib21)\)\. The average RMSE is reduced by22%22\\%, decreasing from3\.8873\.887for ADiff4TPP to3\.0083\.008for ReDiTT\. At the same time, the average type accuracy increases by 12 percentage points, from42\.4%42\.4\\%to55\.2%55\.2\\%\. The advantages of ReDiTT are especially pronounced on Breakfast and MultiThumos, which feature large event vocabularies but substantially fewer training sequences\. In this low\-data, high\-cardinality regime, purely parametric models are prone to sparse supervision for rare event types\. Retrieval provides valuable exemplar\-based guidance by exposing the model to structurally similar trajectories and richer type co\-occurrence patterns\. On Breakfast, which contains 177 event types, ReDiTT improves type accuracy from8\.2%8\.2\\%to15\.1%15\.1\\%\. A consistent trend is observed on MultiThumos with 65 event types, where ReDiTT yields a large accuracy gain from16\.3%16\.3\\%to25\.0%25\.0\\%\. These results indicate that retrieval is particularly effective when the label space is large and training coverage per class is limited\.

#### Long horizon prediction\.

For long\-horizon prediction, ReDiTT consistently reduces OTD at horizonsm=5,10,20,30m=5,10,20,30on six datasets compared to the strongest diffusion baseline\(Mukherjeeet al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib21)\)\. This result demonstrates that retrieval guidance substantially improves sequence\-level coherence beyond single\-step prediction\. The gains are most pronounced on Amazon, where ReDiTT lowers OTD from 12\.4 to 10\.7 at horizon 10 and from 32\.9 to 25\.8 at horizon 30, indicating that the advantages of retrieval\-augmented conditioning grow as the prediction horizon increases\. Similar patterns are observed on Retweet and StackOverflow, where ReDiTT consistently achieves the best OTD across horizons, highlighting the robustness of the approach under diverse temporal dynamics\. These long\-horizon improvements are driven by the retrieval\-conditional design, which injects trajectory\-relevant training examples as explicit context\. This design enables the model to generate multiple future events coherently while preserving temporal ordering and capturing long\-range sequential structure\. On Taxi, ReDiTT achieves the best RMSE and accuracy, while OTD is optimized at smaller retrieval sizes\. This behavior aligns with the dataset characteristics, which include short sequences and a limited event vocabulary\. In this setting, retrieval provides smaller incremental benefits because sequence\-level alignment is already well constrained\. Overall, these findings support the core motivation of retrieval\-augmented conditioning\. By injecting trajectory\-relevant training examples as explicit context, the model is more effectively guided toward plausible future dynamics\.

### 5\.3Ablation Studies

Different Conditioning Architecture\.As discussed inPeebles and Xie\([2023](https://arxiv.org/html/2607.12391#bib.bib23)\), adaptive layer norm often outperforms cross\-attention conditioning in diffusion transformers for class\-labeled image generation\. We therefore conduct an ablation on five datasets with fixedk=1k=1to analyze which conditioning architecture better suits asynchronous event sequences\. Following the design inPeebles and Xie\([2023](https://arxiv.org/html/2607.12391#bib.bib23)\), we implement adaLN conditioning on𝐫\{\\mathbf\{r\}\}and also consider Concat\(s,𝐫\)\(s,\{\\mathbf\{r\}\}\), which concatenates the diffusion timestampsswith𝐫\{\\mathbf\{r\}\}to encode temporal information, i\.e\. three paths forss,𝐫\{\\mathbf\{r\}\}and the fused Concat\(s,𝐫\)\(s,\{\\mathbf\{r\}\}\), each is controlled by a scale hyperparameter\. More details can be found in Appendix[Section˜B\.3](https://arxiv.org/html/2607.12391#A2.SS3)\. As reported in[Table˜2](https://arxiv.org/html/2607.12391#S5.T2), cross\-attention consistently yields stronger long\-horizon behavior, achieving substantially lower OTD, whereas adaLN only improves event\-type accuracy on three of the five datasets and often degrades sequence\-level alignment\. StackOverflow illustrates the trade\-off clearly\. adaLN achieves better next\-event metrics, but its long\-horizon alignment is much worse\. In contrast, cross\-attention produces more coherent multi\-step forecasts \(OTD 10\.8 at horizon 10 and 27\.4 at horizon 30\), even though its next event prediction accuracy is lower and RMSE is higher\. For the other three datasets except for Taxi, we observe a similar pattern: any gains adaLN provides in next\-event RMSE or type accuracy are relatively modest, while its long\-horizon OTD deteriorates substantially\. This indicates that adaLN’s improvements are largely limited to short\-term, local prediction, whereas cross\-attention is far more reliable for preserving sequence\-level alignment over extended horizons\.

We attribute this difference to the mismatch between the inductive bias of adaLN and the structure of conditioning signals in asynchronous time series\. In class\-labeled image generation, the condition is typically a single global discrete cue shared across the entire sample; in this setting, adaLN’s global, layer\-wise modulation can effectively inject the label signal and amplify class conditional priors\. In contrast, for asynchronous time series, retrieved input\-like references are high\-entropy and event\-dependent, with information that varies across events and time\. Cross\-attention therefore provides a more suitable mechanism by enabling state\-dependent access to context and selectively integrating temporal patterns as the generated history evolves\. Overall, the observed trade\-off suggests that adaLN primarily strengthens categorical discrimination, whereas cross\-attention better supports precise, context\-aligned modeling of event times\. Moreover, adaLN is also more expensive in our implementation, resulting in a 294M parameter model, whereas the cross\-attention variant is substantially lighter with only 209M parameters\. Cross\-attention also converges faster in practice, reaching strong performance in fewer training iterations\. To obtain both predictive quality and computational efficiency, we adopt cross\-attention conditioning in our final model\.

Table 2:Analysis of different conditioning architecture of DiT for five datasets with a fixedk=1k=1\. For unconditional training, we refer to ADiff4TPP\.Different Aggregation of Retrieved References\.We further compare two strategies for incorporating the topkkretrieved references during conditioning: average pooling and concatenation\. We perform the experiments on StackOverflow, Breakfast, and MultiThumos, and the results are illustrated in[Table˜3](https://arxiv.org/html/2607.12391#S5.T3)\. Under a fixed retrieval budgetkk, we observe that average pooling of the retrieved references consistently outperforms concatenation across three metrics\. Moreover, askkincreases, the performance gap widens, mostly notably on event\-type prediction accuracy\. For concatenation, the accuracy atk=7k=7is lower than atk=5k=5for StackOverflow and Breakfast\. We hypothesize that pooling becomes increasingly beneficial with larger retrieved sets because it acts as a robust aggregation operator, that being said, it emphasizes signals that are consistent across references with high similarity weights while dampening irrelevant information\. In contrast, concatenation scales the conditioning length linearly withkk, which increases exposure to irrelevant retrievals and makes it easier for the model to overfit to noisy reference\. The results showed that this effect becomes more obvious askkgrows, leading to a larger degradation in categorical prediction\. We therefore adopt average pooling in our conditioning implementation\.

Table 3:Analysis of the different aggregation strategy and differentkkfor retrieved references on StackOverflow, Breakfast, and MultiThumos\. Overall, increasingkkleads to improved performance, and average pooling outperforms concatenation askkincreases\.Differentkkfor Retrieval Mechanism\.We also conducted an ablation study on the number of retrieved referenceskkto further investigate how the amount of retrieved context influences conditioning effectiveness while keeping all other settings fixed, specifically, whether a small set of references provides sufficient guidance for generation, or whether increasingkkintroduces irrelevant matches that act as noise and degrade performance\. As listed in[Table˜3](https://arxiv.org/html/2607.12391#S5.T3), largerkkdoes not improves the results for concatenation conditioning much\. However, for average pooling conditioning, increasingkkconsistently improves both RMSE and event type accuracy, whereas OTD remains largely stable across different values ofkk\. This suggests that retrieving more neighbors can provide additional contextual signal that helps the model refine local predictions, particularly for event type inference, while preserving the global sequence level structure captured by OTD\. Notably, for StackOverflow, event type accuracy reaches 53% atk=7k=7, representing a 10\.9 point improvement overk=1k=1\. This indicates that multi\-reference conditioning is beneficial, and a moderate retrieval size can yield significant gains, especially for categorical prediction, while preserving long\-horizon sequence alignment\.

Effect of Time and Type Conditioning Components\.We further ablate the conditioning signal by using time\-only or event\-type\-only guidance\. Because retrieval is performed in the latent space, we first retrieve reference sequences via latent similarity, and then mask out the undesired modality by replacing the corresponding latent block \(time or type\) with a zero latent \(i\.e\., the latent obtained by encoding an all\-zero input in the original space\), while keeping the other block unchanged\. This design isolates the contribution of each modality without altering the retrieval set\.

We evaluate this ablation on Taobao \(20 event types\), Breakfast \(177 event types\), and Multithumos \(64 event types\) with fixedk=1k=1\. As shown in[Table˜4](https://arxiv.org/html/2607.12391#S5.T4), each modality contributes useful but incomplete information\. Time\-only conditioning can improve metrics that are more sensitive to temporal dynamics, while event\-type\-only conditioning can perform better on metrics that depend more on categorical structure\. However, neither single component consistently dominates across all evaluation criteria, indicating that time and type provide complementary guidance\. When both conditioning blocks are used together, the model achieves strong and balanced performance across all metrics, suggesting that jointly conditioning on temporal and event\-type information enables the retrieval guidance to capture both when events occur and what events occur\. This supports the design choice of using the full time\-and\-type conditioning signal rather than relying on either modality alone\.

Table 4:Analysis of different conditioning components with a fixedk=1k=1on Taobao, Breakfast, and MultiThumos\. Overall, conditioning on both event time and event type outperforms conditioning on either time or type alone\.
## 6Conclusion

We propose ReDiTT, a retrieval augmented conditional Diffusion Transformer for asynchronous event sequence forecasting that models the joint uncertainty of the next inter event time and event type\. ReDiTT operates in latent space and uses a memory bank to retrieve structurally similar latent sequences as reference conditions during training and inference\. The retrieved references are injected through cross attention in DiT blocks, enabling the model to selectively use trajectory specific temporal patterns that are hard to capture with purely parametric conditioning\. Across seven real world datasets, ReDiTT achieves state\-of\-the\-art results on both next event prediction and long horizon forecasting\. Ablations confirm the value of retrieval based conditioning and cross attention integration, and show that structured guidance is critical for stable long horizon generation in temporal point processes\.

## References

- E\. Bacry, I\. Mastromatteo, and J\. Muzy \(2015\)Hawkes processes in finance\.Market Microstructure and Liquidity1\(01\),pp\. 1550005\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- A\. Blattmann, R\. Rombach, K\. Oktay, J\. Müller, and B\. Ommer \(2022\)Retrieval\-augmented diffusion models\.Advances in Neural Information Processing Systems35,pp\. 15309–15324\.Cited by:[§2\.3](https://arxiv.org/html/2607.12391#S2.SS3.p1.1)\.
- N\. Du, H\. Dai, R\. Trivedi, U\. Upadhyay, M\. Gomez\-Rodriguez, and L\. Song \(2016\)Recurrent marked temporal point processes: embedding event history to vector\.InProceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining,pp\. 1555–1564\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p2.1),[§2\.1](https://arxiv.org/html/2607.12391#S2.SS1.p1.8),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- J\. Enguehard, D\. Busbridge, A\. Bozson, C\. Woodcock, and N\. Hammerla \(2020\)Neural temporal point processes for modelling electronic health records\.InMachine Learning for Health,pp\. 85–113\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- P\. Esser, S\. Kulal, A\. Blattmann, R\. Entezari, J\. Müller, H\. Saini, Y\. Levi, D\. Lorenz, A\. Sauer, F\. Boesel,et al\.\(2024\)Scaling rectified flow transformers for high\-resolution image synthesis\.InForty\-first international conference on machine learning,Cited by:[§3\.2](https://arxiv.org/html/2607.12391#S3.SS2.p1.12)\.
- S\. Han, S\. Lee, M\. Cha, S\. O\. Arik, and J\. Yoon \(2025\)Retrieval augmented time series forecasting\.InForty\-second International Conference on Machine Learning,Cited by:[§2\.3](https://arxiv.org/html/2607.12391#S2.SS3.p1.1)\.
- A\. G\. Hawkes \(1971\)Spectra of some self\-exciting and mutually exciting point processes\.Biometrika58\(1\),pp\. 83–90\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p2.1)\.
- S\. Hernandez, P\. Alvarez, J\. Fabra, and J\. Ezpeleta \(2017\)Analysis of users’ behavior in structured e\-commerce websites\.IEEE Access5,pp\. 11941–11958\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- I\. Higgins, L\. Matthey, A\. Pal, C\. Burgess, X\. Glorot, M\. Botvinick, S\. Mohamed, and A\. Lerchner \(2017\)Beta\-vae: learning basic visual concepts with a constrained variational framework\.InInternational conference on learning representations,Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p3.1)\.
- Z\. Jin, S\. Guo, N\. Chen, D\. Weiskopf, D\. Gotz, and N\. Cao \(2020\)Visual causality analysis of event sequence data\.IEEE transactions on visualization and computer graphics27\(2\),pp\. 1343–1352\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- U\. Khandelwal, O\. Levy, D\. Jurafsky, L\. Zettlemoyer, and M\. Lewis \(2019\)Generalization through memorization: nearest neighbor language models\.arXiv preprint arXiv:1911\.00172\.Cited by:[§2\.3](https://arxiv.org/html/2607.12391#S2.SS3.p1.1)\.
- Q\. Kong, P\. Calderon, R\. Ram, O\. Boichak, and M\. Rizoiu \(2023\)Interval\-censored transformer hawkes: detecting information operations using the reaction of social systems\.InProceedings of the ACM web conference 2023,pp\. 1813–1821\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- H\. Kuehne, A\. Arslan, and T\. Serre \(2014\)The language of actions: recovering the syntax and semantics of goal\-directed human activities\.InProceedings of the IEEE conference on computer vision and pattern recognition,pp\. 780–787\.Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1)\.
- S\. Lee, Z\. Lin, and G\. Fanti \(2024\)Improving the training of rectified flows\.Advances in neural information processing systems37,pp\. 63082–63109\.Cited by:[§3\.2](https://arxiv.org/html/2607.12391#S3.SS2.p1.12)\.
- J\. Leskovec and A\. Krevl \(2014\)SNAP Datasets: Stanford large network dataset collection\.Note:[http://snap\.stanford\.edu/data](http://snap.stanford.edu/data)Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1)\.
- Z\. Li \(2025\)Retrieval\-augmented forecasting with tabular time series data\.InProceedings of the 4th Table Representation Learning Workshop,pp\. 192–199\.Cited by:[§2\.3](https://arxiv.org/html/2607.12391#S2.SS3.p1.1)\.
- Y\. Lipman, R\. T\. Chen, H\. Ben\-Hamu, M\. Nickel, and M\. Le \(2023\)Flow matching for generative modeling\.InThe Eleventh International Conference on Learning Representations,Cited by:[§3\.2](https://arxiv.org/html/2607.12391#S3.SS2.p1.12)\.
- J\. Liu, L\. Yang, H\. Li, and S\. Hong \(2024\)Retrieval\-augmented diffusion models for time series forecasting\.Advances in Neural Information Processing Systems37,pp\. 2766–2786\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p4.1),[§2\.3](https://arxiv.org/html/2607.12391#S2.SS3.p1.1)\.
- X\. Liu, C\. Gong,et al\.\(2023\)Flow straight and fast: learning to generate and transfer data with rectified flow\.InThe Eleventh International Conference on Learning Representations,Cited by:[§3\.2](https://arxiv.org/html/2607.12391#S3.SS2.p1.12)\.
- L\. Lorch, A\. De, S\. Bhatt, W\. Trouleau, U\. Upadhyay, and M\. Gomez\-Rodriguez \(2018\)Stochastic optimal control of epidemic processes in networks\.arXiv preprint arXiv:1810\.13043\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- D\. Lüdke, M\. Biloš, O\. Shchur, M\. Lienen, and S\. Günnemann \(2023\)Add and thin: diffusion for temporal point processes\.Advances in Neural Information Processing Systems36,pp\. 56784–56801\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p3.1),[§2\.1](https://arxiv.org/html/2607.12391#S2.SS1.p1.8),[§2\.2](https://arxiv.org/html/2607.12391#S2.SS2.p1.1),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- N\. Mehrasa, A\. A\. Jyothi, T\. Durand, J\. He, L\. Sigal, and G\. Mori \(2019\)A variational auto\-encoder model for stochastic point processes\.InProceedings of the IEEE/CVF conference on computer vision and pattern recognition,pp\. 3165–3174\.Cited by:[§2\.1](https://arxiv.org/html/2607.12391#S2.SS1.p1.8)\.
- H\. Mei and J\. M\. Eisner \(2017\)The neural hawkes process: a neurally self\-modulating multivariate point process\.Advances in neural information processing systems30\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p2.1),[§1](https://arxiv.org/html/2607.12391#S1.p2.1),[§2\.1](https://arxiv.org/html/2607.12391#S2.SS1.p1.8),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- H\. Mei, G\. Qin, and J\. Eisner \(2019\)Imputing missing events in continuous\-time event streams\.InInternational Conference on Machine Learning,pp\. 4475–4485\.Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p3.6)\.
- A\. Mukherjee, R\. Deng, H\. Zhao, Y\. Mao, L\. Sigal, and F\. Tung \(2025\)ADiff4TPP: Asynchronous Diffusion Models for Temporal Point Processes\.arXiv 2504\.20411\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p3.1),[§B\.2](https://arxiv.org/html/2607.12391#A2.SS2.p1.9),[§B\.2](https://arxiv.org/html/2607.12391#A2.SS2.p2.3),[§B\.3](https://arxiv.org/html/2607.12391#A2.SS3.p6.1),[§B\.4](https://arxiv.org/html/2607.12391#A2.SS4.p2.8),[§1](https://arxiv.org/html/2607.12391#S1.p3.1),[§2\.2](https://arxiv.org/html/2607.12391#S2.SS2.p1.1),[§3\.2](https://arxiv.org/html/2607.12391#S3.SS2.p3.5),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p3.6),[§5\.2](https://arxiv.org/html/2607.12391#S5.SS2.8),[§5\.2](https://arxiv.org/html/2607.12391#S5.SS2.SSS0.Px1.p1.9),[§5\.2](https://arxiv.org/html/2607.12391#S5.SS2.SSS0.Px2.p1.1)\.
- J\. Ni, J\. Li, and J\. McAuley \(2019\)Justifying recommendations using distantly\-labeled reviews and fine\-grained aspects\.InProceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing \(EMNLP\-IJCNLP\),pp\. 188–197\.Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1)\.
- K\. Ning, Z\. Pan, Y\. Liu, Y\. Jiang, J\. Y\. Zhang, K\. Rasul, A\. Schneider, L\. Ma, Y\. Nevmyvaka, and D\. Song \(2025\)Ts\-rag: retrieval\-augmented generation based time series foundation models are stronger zero\-shot forecaster\.arXiv preprint arXiv:2503\.07649\.Cited by:[§2\.3](https://arxiv.org/html/2607.12391#S2.SS3.p1.1)\.
- A\. Panos \(2024\)Decomposable transformer point processes\.Advances in Neural Information Processing Systems37,pp\. 88932–88955\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p3.1),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- W\. Peebles and S\. Xie \(2023\)Scalable diffusion models with transformers\.InProceedings of the IEEE/CVF international conference on computer vision,pp\. 4195–4205\.Cited by:[§B\.3](https://arxiv.org/html/2607.12391#A2.SS3.p1.2),[§1](https://arxiv.org/html/2607.12391#S1.p3.1),[§5\.3](https://arxiv.org/html/2607.12391#S5.SS3.p1.8)\.
- K\. Rasul, C\. Seward, I\. Schuster, and R\. Vollgraf \(2021\)Autoregressive denoising diffusion models for multivariate probabilistic time series forecasting\.InInternational conference on machine learning,pp\. 8857–8868\.Cited by:[§2\.2](https://arxiv.org/html/2607.12391#S2.SS2.p1.1)\.
- M\. Rizoiu, S\. Mishra, Q\. Kong, M\. Carman, and L\. Xie \(2018\)Sir\-hawkes: on the relationship between epidemic models and hawkes point processes\.The Web Confernce\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- M\. Schirmer, M\. Eltayeb, S\. Lessmann, and M\. Rudolph \(2022\)Modeling irregular time series with continuous recurrent units\.InInternational conference on machine learning,pp\. 19388–19405\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- O\. Shchur, M\. Biloš, and S\. Günnemann \(2020\)Intensity\-free learning of temporal point processes\.InInternational Conference on Learning Representations,Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p2.1),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- Y\. Tashiro, J\. Song, Y\. Song, and S\. Ermon \(2021\)Csdi: conditional score\-based diffusion models for probabilistic time series imputation\.Advances in neural information processing systems34,pp\. 24804–24816\.Cited by:[§2\.2](https://arxiv.org/html/2607.12391#S2.SS2.p1.1)\.
- K\. Tire, E\. O\. Taga, M\. E\. Ildiz, and S\. Oymak \(2024\)Retrieval augmented time series forecasting\.arXiv preprint arXiv:2411\.08249\.Cited by:[§2\.3](https://arxiv.org/html/2607.12391#S2.SS3.p1.1)\.
- C\. Whong \(2014\)Nyc taxi open data\.Note:[https://chriswhong\.com/open\-data/foil\_nyc\_taxi/](https://chriswhong.com/open-data/foil_nyc_taxi/)Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1)\.
- S\. Xue, X\. Shi, Z\. Chu, Y\. Wang, H\. Hao, F\. Zhou, C\. Jiang, C\. Pan, J\. Y\. Zhang, Q\. Wen,et al\.\(2023\)Easytpp: towards open benchmarking temporal point processes\.arXiv preprint arXiv:2307\.08097\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p1.1),[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p2.1),[§B\.4](https://arxiv.org/html/2607.12391#A2.SS4.p2.8),[§1](https://arxiv.org/html/2607.12391#S1.p1.1),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p3.6),[§5\.2](https://arxiv.org/html/2607.12391#S5.SS2.8)\.
- S\. Xue, X\. Shi, J\. Zhang, and H\. Mei \(2022\)Hypro: a hybridly normalized probabilistic model for long\-horizon prediction of event sequences\.Advances in Neural Information Processing Systems35,pp\. 34641–34650\.Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- C\. Yang, H\. Mei, and J\. Eisner \(2021\)Transformer embeddings of irregularly spaced events and their participants\.arXiv preprint arXiv:2201\.00044\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p2.1),[§1](https://arxiv.org/html/2607.12391#S1.p2.1),[§2\.1](https://arxiv.org/html/2607.12391#S2.SS1.p1.8),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- S\. Yeung, O\. Russakovsky, N\. Jin, M\. Andriluka, G\. Mori, and L\. Fei\-Fei \(2018\)Every moment counts: dense detailed labeling of actions in complex videos\.International Journal of Computer Vision126\(2\),pp\. 375–389\.Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1)\.
- Y\. Yuan, J\. Ding, C\. Shao, D\. Jin, and Y\. Li \(2023\)Spatio\-temporal diffusion point processes\.InProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining,pp\. 3173–3184\.Cited by:[§2\.2](https://arxiv.org/html/2607.12391#S2.SS2.p1.1)\.
- M\. Zeng, F\. Regol, and M\. Coates \(2024\)Interacting diffusion processes for event sequence forecasting\.InProceedings of the 41st International Conference on Machine Learning,pp\. 58407–58430\.Cited by:[§2\.2](https://arxiv.org/html/2607.12391#S2.SS2.p1.1)\.
- Q\. Zhang, A\. Lipani, O\. Kirnap, and E\. Yilmaz \(2020\)Self\-attentive hawkes process\.InInternational conference on machine learning,pp\. 11183–11193\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p2.1),[§1](https://arxiv.org/html/2607.12391#S1.p2.1),[§2\.1](https://arxiv.org/html/2607.12391#S2.SS1.p1.8),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.
- W\. Zhang, C\. Yin, H\. Liu, X\. Zhou, and H\. Xiong \(2024\)Irregular multivariate time series forecasting: a transformable patching graph neural networks approach\.InForty\-first International Conference on Machine Learning,Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- Y\. Zhang, D\. Cao, and Y\. Liu \(2022\)Counterfactual neural temporal point process for estimating causal influence of misinformation on social media\.Advances in Neural Information Processing Systems35,pp\. 10643–10655\.Cited by:[§1](https://arxiv.org/html/2607.12391#S1.p1.1)\.
- K\. Zhou, H\. Zha, and L\. Song \(2013\)Learning triggering kernels for multi\-dimensional hawkes processes\.InInternational conference on machine learning,pp\. 1301–1309\.Cited by:[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p1.1)\.
- W\. Zhou, Z\. Kang, L\. Tian, J\. Zhang, and Y\. Liu \(2025\)Non\-autoregressive diffusion\-based temporal point processes for continuous\-time long\-term event prediction\.Expert Systems with Applications267,pp\. 126210\.Cited by:[§2\.2](https://arxiv.org/html/2607.12391#S2.SS2.p1.1)\.
- S\. Zuo, H\. Jiang, Z\. Li, T\. Zhao, and H\. Zha \(2020\)Transformer hawkes process\.InInternational conference on machine learning,pp\. 11692–11702\.Cited by:[§B\.1](https://arxiv.org/html/2607.12391#A2.SS1.p2.1),[§1](https://arxiv.org/html/2607.12391#S1.p2.1),[§2\.1](https://arxiv.org/html/2607.12391#S2.SS1.p1.8),[§5\.1](https://arxiv.org/html/2607.12391#S5.SS1.p2.4)\.

## Appendix ADiscussion

Limitations\.Although ReDiTT achieves substantial empirical gains, it introduces additional system overhead by requiring a reference bank and performing retrieval at inference time, which increases both memory usage and latency\. Another limitation is that gains can be limited on small\-scale datasets, especially when the sequence length is relatively short, the model might have limited improvement on capturing long range behaviors\.

Future Work\.Future directions include learning retrieval representations that are better aligned with forecasting objectives, and making conditioning more robust via reference weighting or retrieval dropout\. On the efficiency side, we can reduce cost with compressed or hierarchical reference banks and caching\. It is also promising to incorporate richer context such as covariates or text, and to explore training objectives that more directly target long\-horizon metrics\.

Broader Impact Statement\.This paper presents a diffusion\-based model for predicting future events from historical data\. Such models may support improved planning and decision\-making by enabling probabilistic forecasts that capture uncertainty and multiple plausible futures\. This can be beneficial in domains where anticipating diverse outcomes is important\. However, predictions of future events can be misinterpreted or misused, particularly if treated as deterministic or deployed in high\-stakes settings without appropriate oversight\. The model may also inherit biases present in training data and does not address issues of fairness or causality\. Additionally, diffusion\-based methods can be computationally demanding, and their environmental and efficiency costs should be considered\. This work is intended as a methodological contribution, and we encourage responsible use and further research on interpretability, fairness, and efficiency\.

## Appendix BImplementation Details

### B\.1Dataset Preparation and Baselines

Following\(Xueet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib11)\), we pad Amazon, Retweet, StackOverflow, Taobao, and Taxi to the maximum sequence length within each dataset\. For Breakfast, we rescale time values by dividing by 100 to stabilize VAE training\. For the two text\-based action datasets, Breakfast and MultiThumos, we encode event types as integer indices in the same way as the other datasets, and split the data into train/validation/test sets with a 70/10/20 ratio\. Additional dataset details are provided in dataset settings of[Table˜6](https://arxiv.org/html/2607.12391#A2.T6)\.

For baseline models, we use the implementations from EasyTPP\(Xueet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib11)\)for RMTPPDuet al\.\([2016](https://arxiv.org/html/2607.12391#bib.bib14)\), NHPMei and Eisner\([2017](https://arxiv.org/html/2607.12391#bib.bib16)\), SAHPZhanget al\.\([2020](https://arxiv.org/html/2607.12391#bib.bib17)\), THPZuoet al\.\([2020](https://arxiv.org/html/2607.12391#bib.bib18)\), AttNHPYanget al\.\([2021](https://arxiv.org/html/2607.12391#bib.bib13)\), and IFTPPShchuret al\.\([2020](https://arxiv.org/html/2607.12391#bib.bib19)\)\.

For other baselines, we adapt DTPPPanos\([2024](https://arxiv.org/html/2607.12391#bib.bib48)\)to predict inter\-event times in their original scale rather than in log space, following ADiff4TPPMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\)\. For Add&ThinLüdkeet al\.\([2023](https://arxiv.org/html/2607.12391#bib.bib20)\), the method outputs only inter\-event times, so we do not report event\-type accuracy or OTD\.

### B\.2VAE Training

Our VAE implementation for asynchronous time series follows ADiff4TPPMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\)\. For each event𝐱=\(t,e\)\{\\mathbf\{x\}\}=\(t,e\), we train aβ\\beta\-VAE consisting of an encoderEϕE\_\{\\phi\}that maps𝐱\{\\mathbf\{x\}\}to a latent variable𝐳\{\\mathbf\{z\}\}, modeled as a Gaussian distribution parameterized by an inferred mean \(and variance\)\. A decoderDϕD\_\{\\phi\}then reconstructs the event from𝐳\{\\mathbf\{z\}\}, producing𝐱~=\(t~,e~\)=Dϕ​\(𝐳\)\\tilde\{\\mathbf\{x\}\}=\(\\tilde\{t\},\\tilde\{e\}\)=D\_\{\\phi\}\(\{\\mathbf\{z\}\}\)\. The wholeβ\\beta\-VAE is optimized with the following objective:

ℒ=\(t−t~\)2\+CE​\(e,e~\)\+β​ℒK​L,\\mathcal\{L\}=\(t\-\\tilde\{t\}\)^\{2\}\+\\text\{CE\}\(e,\\tilde\{e\}\)\+\\beta\\mathcal\{L\}\_\{KL\},\(12\)
β\\betacontrols the weight of the KL regularization term, which penalizes deviations of the latent distribution𝒳\\mathcal\{X\}from a standard Gaussian prior\. As shown in the VAE settings of[Table˜6](https://arxiv.org/html/2607.12391#A2.T6), we use the sameβ\\betachoices reported in the appendix ofMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\)\.

### B\.3DiT Implementation

Adapting DiT for Asynchronous Time Series\.FollowingPeebles and Xie\([2023](https://arxiv.org/html/2607.12391#bib.bib23)\), we instantiatevθ​\(⋅,𝑨​\(s\)\)v\_\{\\theta\}\(\\cdot,\{\\bm\{A\}\}\(s\)\)with a Diffusion Transformer \(DiT\) backbone, since its Transformer blocks provide a flexible way to model long\-range dependencies while remaining compatible with diffusion or flow\-style training objectives\. We only make minimal modifications to adapt DiT from images to asynchronous event sequences\. In particular, we remove the image\-specific patchify and patch\-embedding modules and instead feed the model with latent event tokens produced by the encoderEϕE\_\{\\phi\}\. This replacement preserves the core DiT computation \(stacked Transformer blocks with conditioning\) while ensuring that the model operates directly on a sequence of event\-level representations, which is the natural input format for asynchronous time series forecasting\.

When initializing the model, we specify a hyperparameterNNthat sets the maximum sequence length the model can represent and generate\. Concretely, sequences shorter thanNNare padded and masked, allowing us to use a fixed token length for efficient batched training and inference while still supporting variable\-length histories and horizons\. Finally, to inject the conditioning matrix𝑨​\(s\)∈ℝN×N\{\\bm\{A\}\}\(s\)\\in\\mathbb\{R\}^\{N\\times N\}, we extend the original DiT conditioning design by constructing an embedding that reflects both temporal progression and structural interactions encoded by𝑨​\(s\)\{\\bm\{A\}\}\(s\)\. We achieve this by broadcasting the entries of𝑨​\(s\)\{\\bm\{A\}\}\(s\)through sinusoidal frequency features, producing a dense embedding that provides the Transformer blocks with a smooth, scale\-aware representation of the matrix\. This design allows the network to exploit the temporal and structural dynamics captured by𝑨​\(s\)\{\\bm\{A\}\}\(s\)without introducing additional architectural complexity\.

Timestep Embedding\.We set the maximum period toTmax=10000T\_\{\\max\}=10000and use an embedding horizon off=128f=128sinusodial frequencies\. Given the diagonal elements of𝑨​\(s\)∈ℝN×N\{\\bm\{A\}\}\(s\)\\in\\mathbb\{R\}^\{N\\times N\}, we construct a frequency\-scaled argument matrix𝑩∈ℝN×h\{\\bm\{B\}\}\\in\\mathbb\{R\}^\{N\\times h\}to encode each event position with multiple time scales\. Concretely, fori∈\{1,⋯,N\}i\\in\\\{1,\\cdots,N\\\}andj∈\{1,⋯,h\}j\\in\\\{1,\\cdots,h\\\}, we define:

𝑩i​j=𝑨​\(s\)i​i⋅Tmax−j−1f\{\\bm\{B\}\}\_\{ij\}=\{\\bm\{A\}\}\(s\)\_\{ii\}\\cdot T\_\{\\max\}^\{\-\\frac\{j\-1\}\{f\}\}\(13\)
so thatjjindexes a geometric progression of frequencies spanning from coarse to fine resolutions\. We then form the final timestep embeddingembs∈ℝN×2​f\\texttt\{emb\}\_\{s\}\\in\\mathbb\{R\}^\{N\\times 2f\}by concatenating sine and cosine features:

embs=\[cos⁡\(𝑩\),sin⁡\(𝑩\)\]\.\\texttt\{emb\}\_\{s\}=\[\\cos\(\{\\bm\{B\}\}\),\\sin\(\{\\bm\{B\}\}\)\]\.\(14\)
Then we map this to the model hidden sizeDDvia an MLP:

embs=𝑾2​SiLU​\(𝑾1​embs\+b1\)\+b2∈ℝN×D\\texttt\{emb\}\_\{s\}=\{\\bm\{W\}\}\_\{2\}\\textbf\{SiLU\}\(\{\\bm\{W\}\}\_\{1\}\\texttt\{emb\}\_\{s\}\+b\_\{1\}\)\+b\_\{2\}\\in\\mathbb\{R\}^\{N\\times D\}\(15\)
Following the choice ofMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\), we define the schedule function𝑨\{\\bm\{A\}\}as:

𝑨​\(s\)i​j=\{0if​i≠j,max⁡\(0,min⁡\(2​N−i−s​\(2​N−1\)N,1\)\)if​i=j,\{\\bm\{A\}\}\(s\)\_\{ij\}=\\begin\{cases\}0&\\text\{if \}i\\neq j,\\\\ \\max\(0,\\min\(\\frac\{2N\-i\-s\(2N\-1\)\}\{N\},1\)\)&\\text\{if \}i=j,\\end\{cases\}\(16\)
which is a diagonal matrix that assigns a separate noise schedule to each event position\. The schedule is constructed so that tokens corresponding to later events receive noise at earlier diffusion times than tokens for earlier events\. Equivalently, later events are corrupted sooner, and the model is trained to denoise them earlier during the reverse process, forcing it to learn forecasting of the sequence tail under higher noise levels\.

This sinusoidal construction provides a smooth multi\-scale representation of the time conditioning signal𝑨​\(s\)\{\\bm\{A\}\}\(s\), allowing the Transformer blocks to access both low frequency \(global\) and high frequency \(local\) temporal variations through a fixed dimension embedding\.

Positional Embedding\.Before entering the DiT blocks, both current latent input and retrieved reference are expanded to hidden sizeDDby channel repetition, for𝐫\{\\mathbf\{r\}\}, we also broadcast the mask𝐦z\{\\mathbf\{m\}\}^\{z\}across the channel dimension\. Then𝐳\{\\mathbf\{z\}\}and𝐫\{\\mathbf\{r\}\}are augmented with fixed positional embeddingsposto get:

𝐳=Repeat​\(𝐳\)\+pos𝐳∈ℝN×D,𝐫=Repeat​\(𝐫\)\+pos𝐫∈ℝN×D,\{\\mathbf\{z\}\}=\\text\{Repeat\}\(\{\\mathbf\{z\}\}\)\+\\texttt\{pos\}\_\{\{\\mathbf\{z\}\}\}\\in\\mathbb\{R\}^\{N\\times D\},\\,\\,\{\\mathbf\{r\}\}=\\text\{Repeat\}\(\{\\mathbf\{r\}\}\)\+\\texttt\{pos\}\_\{\{\\mathbf\{r\}\}\}\\in\\mathbb\{R\}^\{N\\times D\},\(17\)
whereposis defined as follows\. For input sequence𝐳\{\\mathbf\{z\}\}withNNbeingnum\_rows, we assign each position an integer “row index"p∈\{0,1,⋯,N−1\}p\\in\\\{0,1,\\cdots,N\-1\\\}\. For embedding dimensionDD, define frequency coefficients:

γi=10000−iD/2,i=0,⋯,D2−1\.\\gamma\_\{i\}=10000^\{\-\\frac\{i\}\{D/2\}\},i=0,\\cdots,\\frac\{D\}\{2\}\-1\.\(18\)The fixed positional embedding for rowppis:

pos​\(p\)=\[sin⁡\(p​γ\),cos⁡\(p​γ\)\]∈ℝD\.\\texttt\{pos\}\(p\)=\[\\sin\(p\\gamma\),\\cos\(p\\gamma\)\]\\in\\mathbb\{R\}^\{D\}\.\(19\)
Stacking all rows gives:

pos∈ℝN×D\\texttt\{pos\}\\in\\mathbb\{R\}^\{N\\times D\}\(20\)
Since our retrieved reference𝐫\{\\mathbf\{r\}\}and input𝐳\{\\mathbf\{z\}\}has the same dimension, so we apply the sameposembedding to both of them\.

Mask Mechanism\.When training or sampling sequences whose lengthnnis smaller than the maximum token budgetNN, we apply an attention mask within multi\-head self\-attention and the multi\-head cross attention\. so that padded positions do not participate in the computation\. The similar strategy is designed in the retrieval process to mask the padded positions\. This masking enforces that the Transformer operates only on valid event tokens, preserving the natural ordering of the sequence and preventing information leakage through padding\. Combined with our asynchronous noise schedule, the masked attention mechanism aligns the model’s computation with the underlying temporal structure of the data\. It also makes the framework compatible with variable\-length inputs and flexible forecasting horizons, since the same architecture can condition on any observed prefix and generate different prediction window sizes without changing the model\.

AdaLN Conditioning Implementation\.We also include the details of our adaLN conditioning for retrieved asynchronous time series\. Inside the DiT block, let𝐳∈ℝN×D\{\\mathbf\{z\}\}\\in\\mathbb\{R\}^\{N\\times D\}be the token features entering the block, we have three conditioning streams:

- •time embeddingembs,
- •reference embedding𝐫\{\\mathbf\{r\}\},
- •fused conditioningConcat\(s,𝐫\)\(s,\{\\mathbf\{r\}\}\)\.

We first apply separate LayerNorms and project the concatenation to the desired dimension:

s=LNs​\(s\),𝐫=LN𝐫​\(𝐫\),cond=Proj​\(Concat​\(s,𝐫\)\)=𝑾cond​\[s;𝐫\]\+bcond∈ℝN×D,s=\\textbf\{LN\}\_\{s\}\(s\),\\,\{\\mathbf\{r\}\}=\\textbf\{LN\}\_\{\\mathbf\{r\}\}\(\{\\mathbf\{r\}\}\),\\,\\text\{cond\}=\\texttt\{Proj\}\(\\texttt\{Concat\}\(s,\{\\mathbf\{r\}\}\)\)=\{\\bm\{W\}\}\_\{\\text\{cond\}\}\[s;\{\\mathbf\{r\}\}\]\+b\_\{\\text\{cond\}\}\\in\\mathbb\{R\}^\{N\\times D\},\(21\)where\[⋅;⋅\]\[\\,\\cdot\\,;\\,\\cdot\\,\]concatenates along channels and𝑾cond∈ℝD×2​D\{\\bm\{W\}\}\_\{\\text\{cond\}\}\\in\\mathbb\{R\}^\{D\\times 2D\}\. Each stream produces a modulation vector via an MLP:

𝑴s=fs​\(s\)∈ℝN×6​D,𝑴𝐫=f𝐫​\(𝐫\)∈ℝN×6​D,𝑴cond=fcond​\(cond\)∈ℝN×6​D\.\{\\bm\{M\}\}\_\{s\}=f\_\{s\}\(s\)\\in\\mathbb\{R\}^\{N\\times 6D\},\\,\{\\bm\{M\}\}\_\{\\mathbf\{r\}\}=f\_\{\\mathbf\{r\}\}\(\{\\mathbf\{r\}\}\)\\in\\mathbb\{R\}^\{N\\times 6D\},\\,\\,\{\\bm\{M\}\}\_\{\\text\{cond\}\}=f\_\{\\text\{cond\}\}\(\\text\{cond\}\)\\in\\mathbb\{R\}^\{N\\times 6D\}\.\(22\)
Then we scale each modulator by a learned scalar passed through a sigmoid:

𝑴s=σ​\(λs\)​𝑴s,𝑴𝐫=σ​\(λ𝐫\)​𝑴𝐫,𝑴cond=σ​\(λcond\)​𝑴cond,\{\\bm\{M\}\}\_\{s\}=\\sigma\(\\lambda\_\{s\}\)\{\\bm\{M\}\}\_\{s\},\\,\{\\bm\{M\}\}\_\{\\mathbf\{r\}\}=\\sigma\(\\lambda\_\{\\mathbf\{r\}\}\)\{\\bm\{M\}\}\_\{\\mathbf\{r\}\},\\,\{\\bm\{M\}\}\_\{\\text\{cond\}\}=\\sigma\(\\lambda\_\{\\text\{cond\}\}\)\{\\bm\{M\}\}\_\{\\text\{cond\}\},\(23\)with trainableλs,λ𝐫,λcond∈ℝ\\lambda\_\{s\},\\lambda\_\{\\mathbf\{r\}\},\\lambda\_\{\\text\{cond\}\}\\in\\mathbb\{R\}\.

The combined modulation is:

𝑴=𝑴s\+𝑴𝐫\+a⋅𝑴cond∈ℝN×6​D,where​a∈\{0,1\}​is a flag hyperparameter\.\{\\bm\{M\}\}=\{\\bm\{M\}\}\_\{s\}\+\{\\bm\{M\}\}\_\{\\mathbf\{r\}\}\+a\\cdot\{\\bm\{M\}\}\_\{\\text\{cond\}\}\\in\\mathbb\{R\}^\{N\\times 6D\},\\,\\text\{where \}a\\in\\\{0,1\\\}\\text\{ is a flag hyperparameter\.\}\(24\)
Then𝑴\{\\bm\{M\}\}is split into sixDD\-dimension tensors and enters the layers as vanilla adaLN in DiT\.

Multi\-reference Cross\-attention by ConcatenatingkkReferences into Lengthk​NkNmemory\.The main query is𝐳∈ℝN×D\{\\mathbf\{z\}\}\\in\\mathbb\{R\}^\{N\\times D\}, and in the average pooling case𝐫∈ℝN×D\{\\mathbf\{r\}\}\\in\\mathbb\{R\}^\{N\\times D\}, we just need to adapt to𝐫∈ℝN×k×D\{\\mathbf\{r\}\}\\in\\mathbb\{R\}^\{N\\times k\\times D\}with per reference masks𝐦∈\{0,1\}k×N\{\\mathbf\{m\}\}\\in\\\{0,1\\\}^\{k\\times N\}\. Similarly to[Section˜4\.3](https://arxiv.org/html/2607.12391#S4.SS3), the only changes are𝑲∈ℝN×k×D,𝑽∈ℝN×k×D\{\\bm\{K\}\}\\in\\mathbb\{R\}^\{N\\times k\\times D\},\{\\bm\{V\}\}\\in\\mathbb\{R\}^\{N\\times k\\times D\}, then split them intoα\\alphaheads with𝑲∈ℝα×\(k​N\)×Dα,𝑽∈ℝα×\(k​N\)×Dα\{\\bm\{K\}\}\\in\\mathbb\{R\}^\{\\alpha\\times\(kN\)\\times\\frac\{D\}\{\\alpha\}\},\{\\bm\{V\}\}\\in\\mathbb\{R\}^\{\\alpha\\times\(kN\)\\times\\frac\{D\}\{\\alpha\}\}\.

### B\.4Hyperparameters and Computation Cost

We report the dataset specifications, model hyperparameters, and computation costs in[Table˜6](https://arxiv.org/html/2607.12391#A2.T6)\.

The long time reported for next\-event prediction mainly comes from the autoregressive evaluation protocol over the full sequence lengthNN\. Following prior work\(Xueet al\.,[2023](https://arxiv.org/html/2607.12391#bib.bib11); Mukherjeeet al\.,[2025](https://arxiv.org/html/2607.12391#bib.bib21)\), we compute this metric by iteratingi=1,⋯,N−1i=1,\\cdots,N\-1and predicting the next event𝐱^i\+1\\hat\{\\mathbf\{x\}\}\_\{i\+1\}conditioned on the prefix\{𝐱1,⋯,𝐱i\}\\\{\{\\mathbf\{x\}\}\_\{1\},\\cdots,\{\\mathbf\{x\}\}\_\{i\}\\\}\. Consequently, obtaining the full set of one\-step\-ahead predictions𝐱^2,⋯,𝐱^N\\hat\{\\mathbf\{x\}\}\_\{2\},\\cdots,\\hat\{\\mathbf\{x\}\}\_\{N\}requiresN−1N\-1separate forward passes, after which RMSE and accuracy are evaluated between𝐱^\\hat\{\\mathbf\{x\}\}and𝐱\{\\mathbf\{x\}\}\. The detailed algorithm is provided in Appendix E ofMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\)\. We use the implementation fromMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\), and this implementation is not optimized for inference; therefore, the reported time could be reduced with further implementation improvements\. For a single sequence, ReDiTT takes 2\.1s for one\-step next\-event prediction, compared to 2\.0s for the unconditional baseline ofMukherjeeet al\.\([2025](https://arxiv.org/html/2607.12391#bib.bib21)\)\. This indicates that the retrieval\-conditioned design adds only a reasonable runtime overhead\. Because next\-event prediction is relatively slow under the standard autoregressive evaluation protocol, this also motivates our long\-horizon prediction setting: instead of repeatedly running one\-step inference many times, we generate an entire future segment in a single run, enabling more efficient forecasting of long sequences\.

We also include the iteration numbers we used in ablation tables in[Table˜7](https://arxiv.org/html/2607.12391#A2.T7)and[Table˜8](https://arxiv.org/html/2607.12391#A2.T8)\. Training iteration is indeed one of the main hyperparameters we tuned, and we will clarify the checkpoint\-selection protocol in the revision\. For each configuration, we trained the model for up to 500k iterations, saved checkpoints every 50k iterations, and evaluated each checkpoint using all three reported criteria: next\-event time error, next\-event type accuracy, and long\-horizon OTD\. We then reported the checkpoint that gave strong and balanced performance across these metrics, rather than selecting using only a single metric\. Table[5](https://arxiv.org/html/2607.12391#A2.T5)shows an example for ReDiTT on MultiThumos withk=7k=7\. We select the 350k checkpoint because it provides the best overall tradeoff across the three objectives\. Although the 300k checkpoint gives the lowest RMSE and later checkpoints slightly improve OTD at some horizons, the 350k checkpoint substantially improves type accuracy while keeping RMSE and OTD competitive\.

Table 5:Checkpoint\-wise performance of ReDiTT on MultiThumos withk=7k=7\. Lower is better for RMSE and OTD; higher is better for accuracy\. We choose the 350k checkpoint to have good results for all of the metrics\.CheckpointRMSE↓\\downarrowAccuracy↑\\uparrowOTD@5↓\\downarrowOTD@10↓\\downarrowOTD@20↓\\downarrowOTD@30↓\\downarrow50k5\.47770\.25488\.374514\.453521\.339821\.3327100k5\.03210\.23558\.331414\.636521\.001419\.8137150k4\.89180\.23828\.627514\.274120\.682620\.2415200k4\.85500\.23718\.445614\.244920\.916720\.0028250k4\.83800\.23558\.500014\.342520\.692919\.9026300k4\.76280\.23768\.345714\.160320\.974919\.7040\\cellcolor\[HTML\]EFEFEF350k\\cellcolor\[HTML\]EFEFEF4\.7974\\cellcolor\[HTML\]EFEFEF0\.2500\\cellcolor\[HTML\]EFEFEF8\.5046\\cellcolor\[HTML\]EFEFEF14\.2710\\cellcolor\[HTML\]EFEFEF20\.8755\\cellcolor\[HTML\]EFEFEF19\.8915400k4\.85660\.24258\.457114\.024320\.565719\.8726450k4\.84510\.24468\.506214\.090420\.549219\.7714

Table 6:ReDiTT Hyperparameters of reported results in[Section˜5\.2](https://arxiv.org/html/2607.12391#S5.SS2)\. For the next\-event prediction task, inference time is reported using an auto\-regressive methodology\.Table 7:To facilitate reproducibility, we report the training iteration counts associated with the results presented in[Table˜2](https://arxiv.org/html/2607.12391#S5.T2)\.Table 8:To facilitate reproducibility, we report the training iteration counts associated with the results presented in[Table˜3](https://arxiv.org/html/2607.12391#S5.T3)and[Table˜4](https://arxiv.org/html/2607.12391#S5.T4)\.
### B\.5Retrieval overhead\.

We further quantify the computational and memory overhead introduced by retrieval\. ReDiTT stores a latent reference bank containing the VAE latent tokens of all training sequences, together with their padding masks\. For a dataset withNtrainN\_\{\\mathrm\{train\}\}training sequences, padded sequence lengthNN, latent dimensiondd, and 32\-bit floating point storage, the dominant memory cost is

Ntrain×N×d×4N\_\{\\mathrm\{train\}\}\\times N\\times d\\times 4bytes, plus a small mask cost of approximately

Ntrain×NN\_\{\\mathrm\{train\}\}\\times Nbytes\. Thus, the reference\-bank memory scales linearly in the number of training sequences, sequence length, and latent dimension\.

To measure retrieval latency, we isolate the exact nearest\-neighbor retrieval step from the rest of inference\. For each dataset, we use a test batch of up to 128 sequences and compute the same masked token\-wise cosine similarity used by ReDiTT between the query prefix latents and all training reference latents\. The measured operation includes latent\-token normalization, the batched similarity computation, masking over valid prefix/reference positions, averaging over valid positions, and the top\-kkselection withk=7k=7\. It does not include the subsequent diffusion ODE solve, so it measures the overhead of the retrieval step itself\. All measurements are performed on a single GPU using the full training reference bank\.

Table 9:Reference\-bank memory and exact\-retrieval latency\. Memory includes the latent token bank and padding masks\. Latency measures exact top\-kkretrieval for one test batch of up to 128 query sequences, excluding the diffusion solve\.Table[9](https://arxiv.org/html/2607.12391#A2.T9)shows that the reference\-bank memory is modest for the benchmark\-scale datasets\. The largest bank is Retweet, requiring approximately320\.5320\.5MB, followed by Amazon at222\.8222\.8MB\. The remaining datasets require substantially less memory, ranging from7\.77\.7MB to52\.052\.0MB\. Exact retrieval latency is also small relative to the diffusion\-based forecasting cost: full\-bank top\-kkretrieval takes about5\.15\.1ms on Retweet and3\.33\.3ms on Amazon, and less than11ms on the smaller datasets\.

The main deployment consideration is scaling to much larger reference banks\. Exact retrieval scales linearly with bank size because each query prefix is compared against all stored training sequences:

O​\(B​Ntrain​N​d\),O\(B\\,N\_\{\\mathrm\{train\}\}\\,N\\,d\),whereBBis the query batch size\. This exact search is practical for the datasets considered here, but for larger deployments the same framework can use approximate nearest\-neighbor search, reference\-bank subsampling, clustering/prototype selection, or cached retrieval results\. Since retrieval is used only to provide conditioning references, these approximations are natural ways to trade a small amount of retrieval precision for lower memory and latency\.

## Appendix CDiagnosing the Analog\-Forecasting Assumption\.

### C\.1When does retrieval help?

Retrieval\-augmented forecasting relies on an analog\-forecasting assumption: if two observed histories are similar, then their future continuations should also be similar\. This assumption is natural for repeated or locally stationary event dynamics, but it may fail when the process is highly stochastic, non\-stationary, or when similar prefixes can lead to different futures\. We therefore add a diagnostic analysis to evaluate whether the references retrieved by ReDiTT are meaningful future templates\.

We use the same retrieval similarity as in the main ReDiTT model\. Consider a padded asynchronous sequence𝐱=\{𝐱1,…,𝐱N\}\{\\mathbf\{x\}\}=\\\{\{\\mathbf\{x\}\}\_\{1\},\\ldots,\{\\mathbf\{x\}\}\_\{N\}\\\}with padding mask𝐦∈\{0,1\}N\{\\mathbf\{m\}\}\\in\\\{0,1\\\}^\{N\}, whereNNis the maximum padded length\. The pretrained VAE encoderEϕE\_\{\\phi\}maps the sequence to per\-event latent tokens𝐳=Eϕ​\(𝐱\)∈ℝN×d\{\\mathbf\{z\}\}=E\_\{\\phi\}\(\{\\mathbf\{x\}\}\)\\in\\mathbb\{R\}^\{N\\times d\}\. We precompute a latent reference bankℬ=\{\(𝐳r,𝐦r\):𝐳r=Eϕ​\(𝐱r\),𝐱r∈𝒳train\}\\mathcal\{B\}=\\\{\(\{\\mathbf\{z\}\}^\{r\},\{\\mathbf\{m\}\}^\{r\}\):\{\\mathbf\{z\}\}^\{r\}=E\_\{\\phi\}\(\{\\mathbf\{x\}\}^\{r\}\),\\,\{\\mathbf\{x\}\}^\{r\}\\in\\mathcal\{X\}\_\{\\mathrm\{train\}\}\\\}\. For a test sequence𝐱q\{\\mathbf\{x\}\}^\{q\}with unpadded lengthLL, prediction horizonmm, and observed prefix lengthn=L−mn=L\-m, we construct a prefix mask𝐦q,n\{\\mathbf\{m\}\}^\{q,n\}such that

𝐦iq,n=1​\[i≤n\],\{\\mathbf\{m\}\}^\{q,n\}\_\{i\}=1\[i\\leq n\],with padded positions also masked out\. Letq=Eϕ​\(𝐱q\)\\textbf\{q\}=E\_\{\\phi\}\(\{\\mathbf\{x\}\}^\{q\}\)denote the latent tokens of the test sequence\. For each candidate reference\(𝐫,𝐦r\)∈ℬ\(\{\\mathbf\{r\}\},\{\\mathbf\{m\}\}^\{r\}\)\\in\\mathcal\{B\}, we compute the same masked token\-wise cosine similarity used in ReDiTT as in[Equation˜5](https://arxiv.org/html/2607.12391#S4.E5):

sim​\(q,𝐫\)=1∑i=1N𝟏​\[𝐦iq,n∧𝐦ir\]​∑i:𝐦iq,n∧𝐦ir⟨q^i,𝐫^i⟩,\\texttt\{sim\}\(\\textbf\{q\},\{\\mathbf\{r\}\}\)=\\frac\{1\}\{\\sum\_\{i=1\}^\{N\}\\mathbf\{1\}\[\{\\mathbf\{m\}\}\_\{i\}^\{q,n\}\\wedge\{\\mathbf\{m\}\}\_\{i\}^\{r\}\]\}\\sum\_\{i:\{\\mathbf\{m\}\}\_\{i\}^\{q,n\}\\wedge\{\\mathbf\{m\}\}\_\{i\}^\{r\}\}\\left\\langle\\hat\{\\textbf\{q\}\}\_\{i\},\\hat\{\{\\mathbf\{r\}\}\}\_\{i\}\\right\\rangle,whereq^i=qi/‖qi‖2\\hat\{\\textbf\{q\}\}\_\{i\}=\\textbf\{q\}\_\{i\}/\\\|\\textbf\{q\}\_\{i\}\\\|\_\{2\}and𝐫^i=𝐫i/‖𝐫i‖2\\hat\{\{\\mathbf\{r\}\}\}\_\{i\}=\{\\mathbf\{r\}\}\_\{i\}/\\\|\{\\mathbf\{r\}\}\_\{i\}\\\|\_\{2\}areℓ2\\ell\_\{2\}\-normalized latent tokens\. We then retrieve the top\-kkreferences according to this similarity:

R​\(q\)=TopK\(𝐫,𝐦r\)∈ℬ⁡sim​\(q,𝐫\)\.R\(\\textbf\{q\}\)=\\operatorname\{TopK\}\_\{\(\{\\mathbf\{r\}\},\{\\mathbf\{m\}\}^\{r\}\)\\in\\mathcal\{B\}\}\\texttt\{sim\}\(\\textbf\{q\},\{\\mathbf\{r\}\}\)\.The only difference from standard ReDiTT inference is that, for this diagnostic, the query mask is explicitly set by the horizonmmso that retrieval uses only the observed prefix𝐱1:nq\{\\mathbf\{x\}\}^\{q\}\_\{1:n\}, while the held\-out suffix𝐱n\+1:n\+mq\{\\mathbf\{x\}\}^\{q\}\_\{n\+1:n\+m\}is reserved for evaluating whether the retrieved reference has a similar future\.

Let𝐫⋆\{\\mathbf\{r\}\}^\{\\star\}be the top\-1 retrieved reference according to this similarity:

𝐫⋆=arg⁡max\(𝐫,𝐦r\)∈ℬ⁡sim​\(q,𝐫\)\.\{\\mathbf\{r\}\}^\{\\star\}=\\arg\\max\_\{\(\{\\mathbf\{r\}\},\{\\mathbf\{m\}\}^\{r\}\)\\in\\mathcal\{B\}\}\\texttt\{sim\}\(\\textbf\{q\},\{\\mathbf\{r\}\}\)\.
We then evaluate whether the future of the retrieved reference is close to the true future of the query\. For test examplejj, with prefix lengthnj=Lj−mn\_\{j\}=L\_\{j\}\-m, we compute

Dret\(j\)​\(m\)=OTD​\(𝐱nj\+1:nj\+mq,j,𝐱nj\+1:nj\+mr⋆,j\)\.D\_\{\\mathrm\{ret\}\}^\{\(j\)\}\(m\)=\\mathrm\{OTD\}\\left\(\{\\mathbf\{x\}\}^\{q,j\}\_\{n\_\{j\}\+1:n\_\{j\}\+m\},\{\\mathbf\{x\}\}^\{r^\{\\star\},j\}\_\{n\_\{j\}\+1:n\_\{j\}\+m\}\\right\)\.As a random baseline, we sample a training reference𝐱rrand,j\{\\mathbf\{x\}\}^\{r\_\{\\mathrm\{rand\}\},j\}uniformly at random and compute

Drand\(j\)​\(m\)=OTD​\(𝐱nj\+1:nj\+mq,j,𝐱nj\+1:nj\+mrrand,j\)\.D\_\{\\mathrm\{rand\}\}^\{\(j\)\}\(m\)=\\mathrm\{OTD\}\\left\(\{\\mathbf\{x\}\}^\{q,j\}\_\{n\_\{j\}\+1:n\_\{j\}\+m\},\{\\mathbf\{x\}\}^\{r\_\{\\mathrm\{rand\}\},j\}\_\{n\_\{j\}\+1:n\_\{j\}\+m\}\\right\)\.Finally, we report the empirical retrieved/random future distance ratio for each dataset:

ρ​\(m\)=1Nm​∑j=1NmDret\(j\)​\(m\)1Nm​∑j=1NmDrand\(j\)​\(m\),\\rho\(m\)=\\frac\{\\frac\{1\}\{N\_\{m\}\}\\sum\_\{j=1\}^\{N\_\{m\}\}D\_\{\\mathrm\{ret\}\}^\{\(j\)\}\(m\)\}\{\\frac\{1\}\{N\_\{m\}\}\\sum\_\{j=1\}^\{N\_\{m\}\}D\_\{\\mathrm\{rand\}\}^\{\(j\)\}\(m\)\},where

Nm=\|\{j:Lj\>m\}\|N\_\{m\}=\\left\|\\\{j:L\_\{j\}\>m\\\}\\right\|is the number of test sequences with at leastmmreal future events\. A valueρ​\(m\)<1\\rho\(m\)<1indicates that retrieved futures are closer to the true futures than random training futures\. We also report the correlation between the prefix similaritysim​\(q,𝐫⋆\)\\texttt\{sim\}\(\\textbf\{q\},\{\\mathbf\{r\}\}^\{\\star\}\)andDret​\(m\)D\_\{\\mathrm\{ret\}\}\(m\); a negative correlation indicates that more similar prefixes tend to have closer futures\.

Table 10:Analog\-forecasting diagnostic\. We report the retrieved/random future OTD ratioρ​\(m\)\\rho\(m\)for prediction horizonmm\. Lower is better, andρ​\(m\)<1\\rho\(m\)<1means the retrieved future is closer to the true future than a random training future\. We also report the correlation between prefix similarity and retrieved future OTD atm=30m=30; more negative values indicate that more similar prefixes tend to have closer futures\.#### Results\.

Table[10](https://arxiv.org/html/2607.12391#A3.T10)shows that the analog\-forecasting assumption holds strongly on some datasets, but not uniformly across all domains\. Taobao, StackOverflow, and Breakfast provide the clearest evidence\. On Taobao, retrieved futures are much closer than random futures across all horizons, withρ​\(m\)≈0\.73\\rho\(m\)\\approx 0\.73–0\.770\.77, and prefix similarity is strongly negatively correlated with future OTD\. StackOverflow shows a similar pattern, withρ​\(m\)\\rho\(m\)reaching approximately0\.750\.75at longer horizons, indicating that retrieved references provide useful future templates\. Breakfast also supports the assumption, with retrieved futures improving over random futures by roughly6%6\\%–17%17\\%depending on the horizon\.

Amazon and Retweet show weaker but still partially positive evidence\. On Amazon, retrieved futures are only modestly closer than random futures, withρ​\(m\)≈0\.93\\rho\(m\)\\approx 0\.93–0\.980\.98, suggesting that retrieval provides useful but relatively weak future information\. Retweet is mixed at short horizons, where retrieved futures are comparable to random futures, but becomes more favorable at longer horizons\. Taxi exhibits a different behavior: retrieved futures are better than random futures, withρ​\(m\)≈0\.84\\rho\(m\)\\approx 0\.84–0\.920\.92, but the correlation between prefix similarity and future OTD is close to zero\. This suggests that retrieval is useful on average, but the similarity score does not reliably rank which references have the closest futures\. MultiTHUMOS shows the weakest analog structure under this diagnostic, withρ​\(m\)\\rho\(m\)close to or slightly above11for most horizons, indicating that nearest latent neighbors are often no better future templates than random references\.

#### Implications for ReDiTT\.

These results clarify when retrieval is expected to help in asynchronous event forecasting\. Retrieval is most reliable when event dynamics contain repeated, locally predictable patterns, so that similar observed prefixes provide informative future templates\. This explains the strong diagnostic results on Taobao, StackOverflow, and Breakfast\. In contrast, when the prefix\-future relationship is noisy, ambiguous, or weakly captured by the retrieval metric, retrieved references may be imperfect or only weakly informative, as observed for MultiTHUMOS and partly for Taxi\.

MultiTHUMOS is therefore best viewed as a stress test for the analog\-forecasting assumption\. Its weak retrieved/random OTD ratios suggest that visually or temporally similar prefixes do not always imply similar future action continuations, possibly due to greater variability in activity progression or multiple plausible futures\. This highlights why ReDiTT should not be interpreted as simply copying retrieved futures\. Instead, retrieved references are used as conditioning signals inside a diffusion model\. When references are strong analogs, gated cross\-attention allows the model to exploit them directly; when references are noisy or imperfect, diffusion\-based refinement can adapt the conditioning signal to the query\. Thus, retrieval provides useful non\-parametric evidence when similar histories imply similar futures, while the diffusion model improves robustness when this relationship is weaker or dataset\-dependent\.

### C\.2Retrieval Sensitivity to Prefix\-Only Neighbor Selection

A potential concern for retrieval\-augmented forecasting is whether the retrieval query uses information that is unavailable at inference time\. In the forecasting setting, the model observes only a prefixx1:nx\_\{1:n\}and predicts future eventsxn\+1:Nx\_\{n\+1:N\}\. Therefore, a retrieved training sequence may contain its full continuation, but it should be selected using only the observed prefix\. To study the practical impact of this issue without retraining all models, we perform a retrieval\-only diagnostic comparing two retrieval queries:1Prefix retrieval: neighbors are selected using only the observed prefixx1:nx\_\{1:n\}; future target tokens are masked before computing cosine similarity\.2Full retrieval: neighbors are selected using the full sequencex1:Nx\_\{1:N\}, which acts as an oracle retrieval query\.

After retrieval, we use the retrieved training sequence as a simple retrieval\-only forecast and evaluate the predicted suffix with OTD\. This diagnostic isolates the retrieval step: if full\-sequence retrieval is much better than prefix retrieval, then future target tokens materially change neighbor selection\. Conversely, if prefix retrieval is close to full retrieval, then the observed prefix already contains enough information to retrieve useful analogs, which suggests that the train\-test retrieval mismatch has limited practical effect\.

Table 11:Retrieval\-only comparison between prefix\-selected and full\-sequence\-selected neighbors\. Values areOTDfull/OTDprefix\\mathrm\{OTD\}\_\{\\mathrm\{full\}\}/\\mathrm\{OTD\}\_\{\\mathrm\{prefix\}\}; values close to 1 indicate that prefix retrieval is comparable to oracle full\-sequence retrieval\.Table[11](https://arxiv.org/html/2607.12391#A3.T11)reports the OTD ratioOTDfull/OTDprefix\\mathrm\{OTD\}\_\{\\mathrm\{full\}\}/\\mathrm\{OTD\}\_\{\\mathrm\{prefix\}\}for prediction horizons 5, 10, 20, and 30\. Lower OTD is better\. Thus, a ratio below 1 indicates that the oracle full\-sequence query improves retrieval, while a ratio near 1 indicates that prefix retrieval performs similarly to full retrieval\. The results show that for five of the seven datasets, prefix retrieval is very close to full\-sequence retrieval\. On Amazon, Breakfast, MultiTHUMOS, Retweet, and StackOverflow, the average ratio lies between 0\.984 and 1\.020\. In these datasets, using the future suffix in the retrieval query does not substantially improve the retrieval\-only forecast\. This supports the claim that the observed prefix is already sufficient to identify useful neighbors\.

Taobao and Taxi are different: full\-sequence retrieval gives noticeably lower OTD, especially for longer horizons\. This indicates that the future suffix contains additional information that can improve oracle neighbor selection\. Therefore, full\-sequence retrieval should not be used as the forecasting\-time query\. This also motivates our evaluation protocol, where future target tokens are masked before retrieval\.

Overall, this analysis helps contextualize the train\-test mismatch concern\. Since prefix retrieval is competitive with full\-sequence retrieval on most datasets, ReDiTT can still perform well when retrieval is restricted to the information available at forecast time\. This suggests that, in many event sequence datasets, the observed prefix already provides enough signal to identify useful training analogs\. The stronger gap on Taobao and Taxi also indicates that the retrieval\-visible token set should be stated explicitly, and that prefix\-masked retrieval during training is an important direction for future work to further align training with the forecasting protocol\. With further exploration on prefix based training, the Taobao and Taxi results might be also improved\.

## Appendix DAdditional Ablation Results

### D\.1Retrieval\-only vs\. Diffusion\-only Ablation\.

To disentangle the contribution of retrieval from the diffusion\-based conditioning architecture, we add a retrieval\-only baseline alongside the diffusion\-only model and full ReDiTT\. The retrieval\-only baseline uses the same reference bank and top\-kkretrieval procedure as ReDiTT, but removes the diffusion model and gated cross\-attention layers: after retrieving the nearest reference sequences, it directly aggregates their continuations in latent space and decodes the result with the pretrained VAE\. This provides a non\-parametric analog forecaster that measures how much predictive signal is already contained in the retrieved futures\.

As empirically shown in[Section˜D\.1](https://arxiv.org/html/2607.12391#A4.SS1), diffusion\-only and retrieval\-only provide complementary but comparable baselines: neither dominates the other consistently, with diffusion\-only performing better on some datasets and retrieval\-only performing better on others\. In contrast, full ReDiTT achieves the best performance on nearly all metrics across the seven datasets, with two exceptions: retrieval\-only obtains the best next\-event prediction accuracy on StackOverflow, and diffusion\-only achieves the best long\-horizon result on Taxi\. These results suggest that retrieval alone is not uniformly sufficient, and diffusion alone also does not fully explain the gains\. Rather, ReDiTT’s main advantage comes from combining the two: retrieved references provide useful analog futures, while the diffusion model with gated cross\-attention can adapt those references to the query instead of directly copying or averaging them\. The exceptions further indicate that the relative value of retrieval and generative refinement depends on the dataset, but the combined ReDiTT model is the most robust overall\.

Table 12:Next\-event prediction and long\-horizon prediction resultsfor ReDiTT, retrieval\-only and diffusion\-only baselines on seven benchmark datasets\. RMSE is computed on the predicted inter\-event time, while Accuracy \(↑\\uparrow\) is computed on the predicted event type\. Long\-horizon forecasting performance is measured by OTD \(↓\\downarrow\) at horizonsm=5,10,20,30m=5,10,20,30\. We use ADiff4TPP as the unconditional diffusion\-only baseline\. Thebest resultsare highlighted in bold, and thesecond best resultsare underlined\.AmazonRetweetStackOverflowTaobaoTaxiBreakfastMultiThumosRMSE \(↓\\downarrow\)Acc% \(↑\\uparrow\)RMSE \(↓\\downarrow\)Acc% \(↑\\uparrow\)RMSE \(↓\\downarrow\)Acc% \(↑\\uparrow\)RMSE \(↓\\downarrow\)Acc% \(↑\\uparrow\)RMSE \(↓\\downarrow\)Acc% \(↑\\uparrow\)RMSE \(↓\\downarrow\)Acc% \(↑\\uparrow\)RMSE \(↓\\downarrow\)Acc% \(↑\\uparrow\)Diffusion\-only0\.41333\.717\.48060\.71\.52434\.80\.14057\.40\.30985\.61\.3608\.25\.98116\.3Retrieval\-only \(k=7\)0\.46329\.720\.62655\.10\.96054\.10\.18150\.90\.29890\.01\.0690\.45\.4500\.4ReDiTT \(k=1\)0\.41049\.515\.23869\.61\.24041\.90\.13458\.80\.25392\.81\.21010\.85\.80017\.2\\rowcolor\[HTML\]EFEFEFReDiTT \(k=7\)0\.35260\.913\.42978\.51\.04853\.00\.14059\.30\.23994\.51\.05415\.14\.79725\.0OTD \(↓\\downarrow\)OTD \(↓\\downarrow\)OTD \(↓\\downarrow\)OTD \(↓\\downarrow\)OTD \(↓\\downarrow\)OTD \(↓\\downarrow\)OTD \(↓\\downarrow\)Diffusion\-only6\.2 / 12\.4 / 24\.7 / 32\.99\.1 / 17\.7 / 28\.0 / 31\.76\.5 / 12\.0 / 22\.3 / 30\.14\.9 / 9\.9 / 20\.4 / 31\.12\.4 / 4\.0 / 6\.8 / 9\.48\.8 / 17\.1 / 24\.3 / 28\.98\.2 / 13\.6 / 21\.1 / 20\.2Retrieval\-only\(k=7\)6\.9 / 13\.1 / 22\.6 / 27\.49\.4 / 18\.0 / 27\.4 / 29\.96\.1 / 11\.5 / 20\.0 / 28\.55\.3 / 10\.1 / 19\.2 / 28\.82\.8 / 4\.3 / 6\.7 / 9\.19\.4 / 18\.0 / 27\.6 / 33\.69\.4 / 17\.2 / 26\.4 / 27\.8ReDiTT \(k=1\)5\.9 / 11\.5 / 21\.3 / 27\.89\.1 / 17\.3 / 26\.9 / 30\.16\.1 / 10\.8 / 19\.4 / 27\.44\.8 / 9\.8 / 19\.8 / 30\.72\.6 / 4\.4 / 7\.9 / 12\.78\.7 / 16\.1 / 22\.1 / 27\.08\.2 / 14\.3 / 20\.6 / 19\.6\\rowcolor\[HTML\]EFEFEF\\cellcolor\[HTML\]EFEFEFReDiTT \(k=7\)\\cellcolor\[HTML\]EFEFEF5\.7 / 10\.7 / 19\.7 / 25\.8\\cellcolor\[HTML\]EFEFEF9\.1 / 17\.2 / 26\.5 / 29\.6\\cellcolor\[HTML\]EFEFEF6\.0 / 10\.7 / 18\.9 / 27\.4\\cellcolor\[HTML\]EFEFEF4\.6 / 9\.4 / 19\.4 / 29\.5\\cellcolor\[HTML\]EFEFEF3\.5 / 5\.0 / 9\.2 / 17\.6\\cellcolor\[HTML\]EFEFEF8\.2 / 15\.4 / 21\.6 / 26\.4\\cellcolor\[HTML\]EFEFEF8\.2 / 14\.1 / 20\.6 / 19\.6

### D\.2Latent vs\. Raw\-space Retrieval Ablation\.

We further evaluate a raw\-space retrieval ablation to test whether ReDiTT’s performance depends specifically on retrieving neighbors in the VAE latent space\. In this variant, we keep the trained ReDiTT model, VAE, reference bank size, and diffusion\-based conditioning architecture fixed, and change only the neighbor\-selection rule\. Instead of computing similarity between latent event representations, we retrieve references using normalized raw event tuples, combining log\-scaled inter\-event time distance with event\-type matching over the observed prefix\. The retrieved references are still provided to the diffusion model as latent sequences, so the ablation isolates the effect of the retrieval space while preserving the rest of the pipeline\. As listed in[Table˜13](https://arxiv.org/html/2607.12391#A4.T13), latent\-space retrieval performs better on most datasets and metrics, but the gap is generally small: raw\-space retrieval remains competitive and often produces similar results\. This suggests that retrieval\-augmented conditioning is itself a robust source of improvement, while latent\-space retrieval provides a modest but consistent advantage and is better aligned with ReDiTT’s latent diffusion target\. It also avoids the need to hand\-design raw\-space similarities over mixed continuous\-discrete, padded asynchronous sequences\.

Table 13:Next\-event prediction and long\-horizon prediction resultsfor ReDiTT, and Raw\-space Retrieval baseline on seven benchmark datasets fork=7k=7\. RMSE is computed on the predicted inter\-event time, while Accuracy \(↑\\uparrow\) is computed on the predicted event type\. Long\-horizon forecasting performance is measured by OTD \(↓\\downarrow\) at horizonsm=5,10,20,30m=5,10,20,30\. Thebest resultsare highlighted in bold, and thesecond best resultsare underlined\.