Beyond MSE: Rethinking the Evaluation Metric and Benchmarking for Irregular Time Series Forecasting
Summary
The paper proposes Continuous-time Squared Error (CSE) as a less biased evaluation metric for irregular time series forecasting and introduces a systematic benchmark to assess models' continuous-time performance.
View Cached Full Text
Cached at: 08/19/26, 10:26 AM
# Rethinking the Evaluation Metric and Benchmarking for Irregular Time Series Forecasting Source: [https://arxiv.org/html/2608.17293](https://arxiv.org/html/2608.17293) Rongwen LiAffiliation:College of Computer Science and Electronic Engineering, Hunan University, Changsha, Hunan, ChinaHaixin XieAffiliation:College of Computer Science and Electronic Engineering, Hunan University, Changsha, Hunan, ChinaXiao WangAffiliation:College of Computer Science and Electronic Engineering, Hunan University, Changsha, Hunan, ChinaChangjian ChenAffiliation:College of Computer Science and Electronic Engineering, Hunan University, Changsha, Hunan, ChinaCorrespondence to:[changjianchen@hnu\.edu\.cn](mailto:[email protected]) ###### Abstract Existing research on irregular time\-series forecasting has primarily focused on model design, while evaluation metrics remain insufficiently studied\. Existing benchmarks typically use mean squared error \(MSE\) as the evaluation metric\. We show that, in irregular forecasting, MSE is determined not only by the model prediction but also by the sample\-specific timestamp sampling distributions, leading to a biased assessment of the models’ continuous\-time predictive performance\. To address this issue, we propose theContinuous\-time Squared Error \(CSE\), which employs importance weighting to eliminate the influence of the timestamp sampling distributions\. We further theoretically prove that CSE’s asymptotic estimation error with respect to continuous\-time risk is no greater than that of MSE\. Finally, we construct a systematic benchmark covering synthetic, semi\-synthetic, and eight real\-world datasets to validate the effectiveness of CSE and systematically evaluate models’ continuous\-time predictive performance\. Experiments show that CSE can recover continuous\-time risk more accurately than MSE, while relying solely on MSE may not fully reflect models’ continuous\-time predictive performance in real\-world scenarios\. Our code can be obtained at https://github\.com/hnu\-vis/ITS\-Bench\. ###### Keywords: Machine Learning, ICML ## 1Introduction Irregular time series are ubiquitous in real\-world applications such as healthcare, environmental monitoring, and human activity analysis\([7](https://arxiv.org/html/2608.17293#bib.bib21);[6](https://arxiv.org/html/2608.17293#bib.bib22);[1](https://arxiv.org/html/2608.17293#bib.bib23)\)\. Unlike regularly sampled time series, their observations occur at non\-uniform timestamps, and different samples may exhibit different sampling patterns\. In recent years, considerable research effort has been devoted to modeling such non\-uniform temporal processes, leading to the development of continuous\-time\([2](https://arxiv.org/html/2608.17293#bib.bib13)\), attention\-based\([20](https://arxiv.org/html/2608.17293#bib.bib5)\), graph\-based\([23](https://arxiv.org/html/2608.17293#bib.bib8)\), and patch\-based\([15](https://arxiv.org/html/2608.17293#bib.bib17)\)models\. However, compared with the rapid progress in model design, evaluation metrics for irregular time\-series forecasting remain insufficiently studied\. Figure 1:Illustration of evaluation bias under non\-uniform sampling\. Although Model B has lower continuous\-time error, Model A obtains a lower MSE because of over\-dense sampling within the interval\[0\.0,0\.4\]\[0\.0,0\.4\]\.For time\-series forecasting, an ideal evaluation metric is the continuous\-time discrepancy between the predicted trajectory and the true trajectoryXXover the entire future interval\. GivenXXover a time span𝒯\\mathcal\{T\}, letℓ\(t,X\)\\ell\(t,X\)denote the prediction error of a model at timett\. This continuous\-time discrepancy is defined as thecontinuous\-time risk: Rct=𝔼X\[1\|𝒯\|∫𝒯ℓ\(t,X\)𝑑t\]\.R\_\{\\mathrm\{ct\}\}=\\mathbb\{E\}\_\{X\}\\left\[\\frac\{1\}\{\|\\mathcal\{T\}\|\}\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)\\,dt\\right\]\.\(1\)This risk directly characterizes the model’s continuous\-time predictive performance over the future interval\. Existing studies typically adopt mean squared error \(MSE\) and mean absolute error \(MAE\), which are widely used in regularly sampled forecasting\. We argue thatin irregular settings, MSE and MAE can be affected by the sample\-specific timestamp sampling distributions and may therefore fail to accurately reflect a model’s performance\.As illustrated in Fig\.[1](https://arxiv.org/html/2608.17293#S1.F1), although Model B has a lower continuous\-time error than Model A \(i\.e\., the orange line of Model B is closer to the black ground truth line over the whole time span\), Model A obtains a lower MSE because of over\-dense sampling within the interval\[0\.0,0\.4\]\[0\.0,0\.4\]\. By theoretical analysis, we find that MSE provides a biased estimate of the continuous\-time riskRctR\_\{ct\}, as it actually measures the observation\-time riskRobs=𝔼X\[∫𝒯ℓ\(t,X\)p\(t∣X\)𝑑t\]R\_\{\\mathrm\{obs\}\}=\\mathbb\{E\}\_\{X\}\[\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)p\(t\\mid X\)\\,dt\], wherep\(t∣X\)p\(t\\mid X\)is the conditional sampling distribution for the timestamps\. This distribution is sample\-specific and thus causes model performance evaluations to be confounded by sample\-specific sampling patterns\. To eliminate the influence of the timestamp sampling distributions on evaluation results, we begin directly fromRctR\_\{\\mathrm\{ct\}\}and construct its empirical estimator, termed theContinuous\-time Squared Error \(CSE\), through importance sampling\. CSE reweights errors according to the observation\-time densityp\(t∣X\)p\(t\\mid X\), reducing the contribution of densely sampled regions while increasing that of sparsely sampled regions, thereby mitigating evaluation bias caused by timestamp sampling distributions\. Returning to Fig\.[1](https://arxiv.org/html/2608.17293#S1.F1), CSE correctly identifies Model B as having the lower continuous\-time error\. We further prove that the asymptotic estimation error of CSE with respect to the continuous\-time risk is no greater than that of MSE\. Finally, we further decompose the discrepancy between MSE and CSE into a sampling\-dependence gap and a temporal\-distribution gap to investigate their respective effects in real\-world settings\. Similarly, we can derive theContinuous\-time Absolute Error \(CAE\)as the debiased counterpart to MAE\. To evaluate the effectiveness of CSE, we require access to the true trajectoryXXof each dataset\. To this end, we construct a systematic benchmark for irregular time\-series forecasting covering synthetic, semi\-synthetic, and real\-world datasets\. Both the synthetic and semi\-synthetic datasets have the true continuous or regular trajectory\. Based on a comprehensive evaluation of this benchmark, we have the following conclusions: \(1\) on synthetic and semi\-synthetic datasets, CSE can recover continuous\-time risk more accurately than MSE under non\-uniform sampling; \(2\) on real\-world datasets, relying solely on MSE may not fully reflect models’ continuous\-time predictive performance; \(3\) the discrepancies between MSE and CSE are jointly influenced by the sampling\-dependence and temporal\-distribution gaps\. The main contributions are summarized as follows: - •Revealing the biased evaluation of MSE for model’s continuous\-time predictive performance\.We show that MSE estimates the observation\-distribution risk rather than the continuous\-time risk, thereby coupling model evaluation with sampling mechanisms\. - •A continuous\-time evaluation metric with theoretical guarantees\.We propose Continuous\-Time Squared Error \(CSE\), which estimates the continuous\-time risk from irregular timestamps through importance weighting, and prove that its asymptotic estimation error is no greater than MSE\. - •A systematic benchmark for continuous\-time evaluation\.We construct a benchmark covering synthetic, semi\-synthetic, and real\-world datasets to validate the effectiveness of CSE, systematically evaluate models’ continuous\-time predictive performance, and analyze the sources of discrepancies between MSE and CSE\. ## 2Related Work ### 2\.1Irregular Time Series Forecasting Irregular time series are typically characterized by sparse, asynchronous, and nonuniform sampling\. Existing studies have primarily focused on modeling continuous\-time dynamics from limited observations\. One line of work explicitly describes the continuous evolution of latent states\. For example, Latent ODE, Neural CDE, and Continuous Recurrent Unit handle arbitrary time intervals based on ordinary differential equations, controlled differential equations, and continuous state transitions, respectively\([18](https://arxiv.org/html/2608.17293#bib.bib1);[10](https://arxiv.org/html/2608.17293#bib.bib2);[19](https://arxiv.org/html/2608.17293#bib.bib3)\)\. Another line of work directly models irregular observations together with their temporal information\. SeFT represents a time series as a set of observations, mTAN employs multi\-time attention to aggregate asynchronous observations, and Raindrop uses graph structures to capture dynamic dependencies among variables\([8](https://arxiv.org/html/2608.17293#bib.bib4);[20](https://arxiv.org/html/2608.17293#bib.bib5);[26](https://arxiv.org/html/2608.17293#bib.bib6)\)\. More recent methods further integrate multiscale representations with graph structures\. For instance, Warpformer models temporal patterns at different scales through time warping, whereas GraFITi formulates irregular forecasting as an information propagation process over a graph\([24](https://arxiv.org/html/2608.17293#bib.bib7);[23](https://arxiv.org/html/2608.17293#bib.bib8)\)\. Despite these advances, existing studies primarily focus on model design and typically evaluate predictions using MSE or MAE at observed future timestamps\. In contrast, we study the evaluation protocol itself and examine how irregular sampling affects model comparison and selection\. ### 2\.2Benchmarks and Evaluation for Irregular Time Series With the growing interest in irregular time series, prior studies have developed related benchmarks from the perspectives of data resources, software frameworks, and standardized experimental settings\. The MIMIC\-IV benchmark organizes unified tasks for sparse and irregular clinical time series and compares a range of representative models\([3](https://arxiv.org/html/2608.17293#bib.bib20)\)\. PYRREGULAR provides unified data structures and analytical tools, together with a standardized benchmark covering multiple datasets and classification methods\([21](https://arxiv.org/html/2608.17293#bib.bib9)\)\. Time\-IMM further introduces new datasets and evaluation benchmarks for irregular multimodal multivariate time series\([4](https://arxiv.org/html/2608.17293#bib.bib10)\)\. For forecasting tasks, Physiome\-ODE constructs controlled datasets from biological ODEs to provide more challenging and discriminative environments for comparing irregular forecasting models\([11](https://arxiv.org/html/2608.17293#bib.bib11)\)\. Existing benchmarks mainly improve datasets, tasks, and experimental standardization rather than the evaluation objective itself\. Physiome\-ODE is the most closely related work: it provides controlled ODE\-generated trajectories to improve model discrimination, but still evaluates predictions using MSE at sampled query times\([11](https://arxiv.org/html/2608.17293#bib.bib11)\)\. Consequently, it does not examine whether model conclusions depend on the query\-time distribution or recover risk over the entire future interval\. In contrast, we take continuous\-time risk as the evaluation target, propose CSE to estimate it, and decompose the resulting evaluation discrepancy into sampling\-dependence and temporal\-distribution gaps\. ## 3Preliminaries ### 3\.1Irregular Time Series Forecasting The dataset containsSSirregular time series\. For thess\-th sequence, its historical observations are denoted by𝒪s=\{\(qs,i,𝐱s,i\)\}i=1Hs\\mathcal\{O\}\_\{s\}=\\\{\(q\_\{s,i\},\\mathbf\{x\}\_\{s,i\}\)\\\}\_\{i=1\}^\{H\_\{s\}\}, whereqs,i∈ℝq\_\{s,i\}\\in\\mathbb\{R\}and𝐱s,i∈ℝD\\mathbf\{x\}\_\{s,i\}\\in\\mathbb\{R\}^\{D\}denote the irregular timestamp and the corresponding multivariate observation, respectively\. Given the historical observations𝒪s\\mathcal\{O\}\_\{s\}, a forecasting modelfθf\_\{\\theta\}aims to estimate the latent process over a future time interval𝒯\\mathcal\{T\}\. For any query timet∈𝒯t\\in\\mathcal\{T\}, the model output is given by𝐗^s\(t\)=fθ\(𝒪s,t\)\\hat\{\\mathbf\{X\}\}\_\{s\}\(t\)=f\_\{\\theta\}\(\\mathcal\{O\}\_\{s\},t\)\. Let𝐗s\(t\)\\mathbf\{X\}\_\{s\}\(t\)denote the ground\-truth latent process, and define the prediction error at timettasℓ\(t,Xs\)=ℒ\(𝐗s\(t\),𝐗^s\(t\)\)\\ell\(t,X\_\{s\}\)=\\mathcal\{L\}\(\\mathbf\{X\}\_\{s\}\(t\),\\hat\{\\mathbf\{X\}\}\_\{s\}\(t\)\)\. In practical test datasets, the ground\-truth values are available only at a finite set of future timestamps\{ts,j\}j=1Ls\\\{t\_\{s,j\}\\\}\_\{j=1\}^\{L\_\{s\}\}, which are generated from the conditional sampling distributionp\(t∣Xs\)p\(t\\mid X\_\{s\}\)\. ### 3\.2MSE and MAE under Irregular Sampling Existing studies on irregular time series forecasting typically compute MSE and MAE at the actually observed future timestamps\. In the following, we use MSE as the example to illustrate the idea, i\.e\.,ℓ\(t,Xs\)=‖𝐗s\(t\)−𝐗^s\(t\)‖2\\ell\(t,X\_\{s\}\)=\\left\\\|\\mathbf\{X\}\_\{s\}\(t\)\-\\hat\{\\mathbf\{X\}\}\_\{s\}\(t\)\\right\\\|^\{2\}\. Accordingly, the MSE on the test set can be written as MSE=1S∑s=1S1Ls∑j=1Lsℓ\(ts,j,Xs\)\.\\mathrm\{MSE\}=\\frac\{1\}\{S\}\\sum\_\{s=1\}^\{S\}\\frac\{1\}\{L\_\{s\}\}\\sum\_\{j=1\}^\{L\_\{s\}\}\\ell\(t\_\{s,j\},X\_\{s\}\)\.\(2\)This metric first averages the prediction errors over the future observations of each trajectory and then assigns equal weight to different trajectories\. When the future timestamps are regarded as conditional samples drawn fromp\(t∣X\)p\(t\\mid X\), the above expression is essentially a Monte Carlo estimator of the following observation\-distribution risk: Robs=𝔼X\[∫𝒯ℓ\(t,X\)p\(t∣X\)𝑑t\]=𝔼X\[𝔼T\|X\[ℓ\(T,X\)\]\]\.R\_\{\\mathrm\{obs\}\}=\\mathbb\{E\}\_\{X\}\\left\[\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)p\(t\\mid X\)\\,dt\\right\]=\\mathbb\{E\}\_\{X\}\\left\[\\mathbb\{E\}\_\{T\\mid X\}\[\\ell\(T,X\)\]\\right\]\.\(3\)Therefore, MSE aggregates prediction errors according to the empirical frequency of future timestamps: densely observed temporal regions receive higher weights in the evaluation, whereas sparsely observed regions receive lower weights\. In other words, the overall evaluation objective of MSE is determined not only by the model’s prediction errors but also by the conditional sampling distributionp\(t∣X\)p\(t\\mid X\)\. ## 4Continuous\-Time Risk for Irregular Forecasting In this section, we first define the continuous\-time risk that directly corresponds to the continuous\-time forecasting objective\. We then construct its empirical estimator, CSE, using importance sampling and analyze the asymptotic properties of CSE relative to MSE\. Finally, we introduce the global\-time risk and decompose the evaluation discrepancy into two components associated with sample\-dependent sampling and population\-level temporal nonuniformity\. ### 4\.1Continuous\-Time Risk As discussed above, the observation\-distribution risk corresponding to MSE is affected by the conditional sampling distributionp\(t∣X\)p\(t\\mid X\), thereby coupling model evaluation with sample\-specific sampling mechanisms\. A natural way to reduce this dependence is to adopt a common target\-time measure across all trajectories\. For continuous\-time forecasting, an ideal evaluation objective should also measure the discrepancy between the predicted trajectory and the ground\-truth process over the entire future interval\. We therefore adopt the uniform temporal measure and define Rct=𝔼X\[1\|𝒯\|∫𝒯ℓ\(t,X\)𝑑t\]\.R\_\{\\mathrm\{ct\}\}=\\mathbb\{E\}\_\{X\}\\left\[\\frac\{1\}\{\|\\mathcal\{T\}\|\}\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)\\,dt\\right\]\.\(4\)RctR\_\{\\mathrm\{ct\}\}assigns equal weight to each unit of time within the future interval and is independent of the sampling distribution of the actual observation times\. It therefore characterizes the forecasting capability of a model over the entire continuous\-time process\. ### 4\.2Estimating Continuous\-Time Risk The test set provides ground\-truth observations only at a finite number of future timestamps, making it impossible to directly compute the continuous\-time integral over the entire interval𝒯\\mathcal\{T\}\. To estimateRctR\_\{\\mathrm\{ct\}\}from the available irregular observations, we use the actual conditional sampling distributionp\(t∣X\)p\(t\\mid X\)as the proposal distribution and rewrite the continuous\-time risk through importance sampling as Rct\\displaystyle R\_\{\\mathrm\{ct\}\}=𝔼X\[∫𝒯ℓ\(t,X\)1\|𝒯\|p\(t∣X\)p\(t∣X\)dt\]\\displaystyle=\\mathbb\{E\}\_\{X\}\\left\[\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)\\frac\{1\}\{\|\\mathcal\{T\}\|p\(t\\mid X\)\}p\(t\\mid X\)\\,dt\\right\]\(5\)=𝔼X\[𝔼T\|X\[ℓ\(T,X\)1\|𝒯\|p\(T∣X\)\]\]\.\\displaystyle=\\mathbb\{E\}\_\{X\}\\left\[\\mathbb\{E\}\_\{T\\mid X\}\\left\[\\ell\(T,X\)\\frac\{1\}\{\|\\mathcal\{T\}\|p\(T\\mid X\)\}\\right\]\\right\]\.Here,1/\(\|𝒯\|p\(t∣X\)\)1/\(\|\\mathcal\{T\}\|p\(t\\mid X\)\)corrects the actual conditional sampling distribution toward the uniform temporal distribution\. It reduces the contribution of each observation in densely sampled regions while increasing the contribution of each observation in sparsely sampled regions, allowing each temporal location to contribute to the evaluation according to the length of the time interval it represents\. In practical datasets, the conditional sampling densityp\(t∣Xs\)p\(t\\mid X\_\{s\}\)is typically unknown\. Letp^\(ts,i∣Xs\)\\hat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)denote the conditional temporal density estimated from the future timestamps of thess\-th trajectory\. Since standard importance sampling may exhibit high finite\-sample variance due to extreme weights, we adopt self\-normalized importance sampling and define the resulting empirical metric under squared error as the Continuous\-Time Squared Error \(CSE\): CSE=1S∑s=1S∑i=1Lsℓ\(ts,i,Xs\)/p^\(ts,i∣Xs\)∑i=1Ls1/p^\(ts,i∣Xs\)\.\\mathrm\{CSE\}=\\frac\{1\}\{S\}\\sum\_\{s=1\}^\{S\}\\frac\{\\sum\_\{i=1\}^\{L\_\{s\}\}\\ell\(t\_\{s,i\},X\_\{s\}\)/\\hat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}\{\\sum\_\{i=1\}^\{L\_\{s\}\}1/\\hat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}\.\(6\)The constant1/\|𝒯\|1/\|\\mathcal\{T\}\|in the uniform temporal density cancels between the numerator and denominator\. For each trajectory, a continuous\-time error estimate is first obtained through self\-normalized weighting, after which these estimates are averaged equally across all test trajectories\. The same construction naturally yields the Continuous\-time Absolute Error \(CAE\) under absolute error\. In the following, we focus on CSE under squared error\. To reduce the influence of an evaluation timestamp on its own density estimate, we employ leave\-one\-out Gaussian kernel density estimation: p^\(ts,i∣Xs\)=1\(Ls−1\)hs∑j=1j≠iLsK\(ts,i−ts,jhs\),\\hat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)=\\frac\{1\}\{\(L\_\{s\}\-1\)h\_\{s\}\}\\sum\_\{\\begin\{subarray\}\{c\}j=1\\\\ j\\neq i\\end\{subarray\}\}^\{L\_\{s\}\}K\\left\(\\frac\{t\_\{s,i\}\-t\_\{s,j\}\}\{h\_\{s\}\}\\right\),\(7\)whereK\(⋅\)K\(\\cdot\)is the Gaussian kernel function andhsh\_\{s\}is the bandwidth associated with thess\-th trajectory\. Excluding the current evaluation point prevents it from introducing additional kernel mass at its own location, thereby yielding a more robust estimate of the local temporal density\. To further demonstrate the advantage of CSE over MSE, we theoretically compare their asymptotic estimation errors with respect to the continuous\-time risk and introduce the following assumption and theorem\. ###### Assumption 4\.1\. Let𝒯\\mathcal\{T\}be a compact interval, and assume that different test trajectories are mutually independent\. Conditional onXsX\_\{s\}, the future timestamps are independently and identically distributed according top\(t∣Xs\)p\(t\\mid X\_\{s\}\)\. Suppose that the loss function is bounded, the conditional sampling density satisfiesp\(t∣X\)≥ρ\>0p\(t\\mid X\)\\geq\\rho\>0, and the density estimatorp^\(t∣X\)\\hat\{p\}\(t\\mid X\)is strongly consistent over𝒯\\mathcal\{T\}\. ###### Theorem 4\.2\(Asymptotic Non\-Inferiority of CSE\)\. LetL¯=min1≤s≤SLs\\underline\{L\}=\\min\_\{1\\leq s\\leq S\}L\_\{s\}\. Under Assumption[4\.1](https://arxiv.org/html/2608.17293#S4.Thmtheorem1), as both the number of test trajectoriesSSand the minimum number of future observations per trajectoryL¯\\underline\{L\}tend to infinity, the following inequality holds almost surely: limS,L¯→∞\|CSE−Rct\|≤limS,L¯→∞\|MSE−Rct\|\.\\lim\_\{S,\\underline\{L\}\\rightarrow\\infty\}\\left\|\\mathrm\{CSE\}\-R\_\{\\mathrm\{ct\}\}\\right\|\\leq\\lim\_\{S,\\underline\{L\}\\rightarrow\\infty\}\\left\|\\mathrm\{MSE\}\-R\_\{\\mathrm\{ct\}\}\\right\|\.\(8\)In particular, equality holds whenp\(t∣X\)=1/\|𝒯\|p\(t\\mid X\)=1/\|\\mathcal\{T\}\|almost everywhere\. The complete proof is provided in the Appendix A\. Theorem[4\.2](https://arxiv.org/html/2608.17293#S4.Thmtheorem2)shows that, under the stated conditions, the asymptotic estimation error of CSE with respect to the continuous\-time risk is no greater than that of MSE\. When future observation times are uniformly distributed, the two metrics are asymptotically equivalent\. When the observation\-distribution risk differs from the continuous\-time risk, CSE achieves a strictly smaller asymptotic error\. ### 4\.3Sources of Evaluation Discrepancy Because MSE and CSE converge to the observation\-distribution risk and the continuous\-time risk, respectively, they may yield different model evaluation results\. To further analyze this discrepancy, we introduce the global\-time risk and decompose the overall discrepancy into two components arising from sample\-dependent sampling and population\-level temporal nonuniformity\. Marginalizing the conditional sampling distribution over trajectories yieldspT\(t\)=𝔼X\[p\(t∣X\)\]p\_\{T\}\(t\)=\\mathbb\{E\}\_\{X\}\[p\(t\\mid X\)\], which describes the distribution of timestamps at the dataset level\. Based on this distribution, we define the global\-time risk as Rglobal=𝔼X\[∫𝒯ℓ\(t,X\)pT\(t\)𝑑t\]\.R\_\{\\mathrm\{global\}\}=\\mathbb\{E\}\_\{X\}\\left\[\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)p\_\{T\}\(t\)\\,dt\\right\]\.\(9\)RglobalR\_\{\\mathrm\{global\}\}removes the influence of sample\-specific sampling mechanisms while retaining the population\-level nonuniform temporal coverage of the dataset\. In this sense, it preserves the global temporal distribution induced by the data collection process, but eliminates the instance\-level irregularity that may bias model evaluation\. It therefore serves as an intermediate reference between the observed riskRobsR\_\{\\mathrm\{obs\}\}and the continuous\-time riskRctR\_\{\\mathrm\{ct\}\}\. Based on this risk, the overall evaluation discrepancy can be decomposed as Robs−Rct\\displaystyle R\_\{\\mathrm\{obs\}\}\-R\_\{\\mathrm\{ct\}\}=Robs−Rglobal⏟Gsamp\+Rglobal−Rct⏟Gtime,\\displaystyle=\\underbrace\{R\_\{\\mathrm\{obs\}\}\-R\_\{\\mathrm\{global\}\}\}\_\{G\_\{\\mathrm\{samp\}\}\}\+\\underbrace\{R\_\{\\mathrm\{global\}\}\-R\_\{\\mathrm\{ct\}\}\}\_\{G\_\{\\mathrm\{time\}\}\},\(10\)whereGsamp\\displaystyle\\text\{where\}\\qquad G\_\{\\mathrm\{samp\}\}=∫𝒯CovX\(ℓ\(t,X\),p\(t∣X\)\)dt,\\displaystyle=\\int\_\{\\mathcal\{T\}\}\\operatorname\{Cov\}\_\{X\}\\left\(\\ell\(t,X\),p\(t\\mid X\)\\right\)\\,dt,Gtime\\displaystyle G\_\{\\mathrm\{time\}\}=CovU∼Unif\(𝒯\)\(ℓ¯\(U\),\|𝒯\|pT\(U\)\),\\displaystyle=\\operatorname\{Cov\}\_\{U\\sim\\operatorname\{Unif\}\(\\mathcal\{T\}\)\}\\left\(\\bar\{\\ell\}\(U\),\|\\mathcal\{T\}\|p\_\{T\}\(U\)\\right\),whereℓ¯\(t\)=𝔼X\[ℓ\(t,X\)\]\\bar\{\\ell\}\(t\)=\\mathbb\{E\}\_\{X\}\[\\ell\(t,X\)\]\. The detailed derivation is provided in the Appendix B\. GsampG\_\{\\mathrm\{samp\}\}is determined by the covariance, across trajectories, between the model errorℓ\(t,X\)\\ell\(t,X\)and the sample\-specific sampling densityp\(t∣X\)p\(t\\mid X\)at a fixed temporal location\. If trajectories with larger errors are more likely to be observed at that time, this term is positive; otherwise, it is negative\. When the sampling process is independent of the trajectory, i\.e\.,p\(t∣X\)=pT\(t\)p\(t\\mid X\)=p\_\{T\}\(t\), we haveGsamp=0G\_\{\\mathrm\{samp\}\}=0\. Therefore,GsampG\_\{\\mathrm\{samp\}\}characterizes the effect induced by sample\-dependent sampling\. GtimeG\_\{\\mathrm\{time\}\}is determined by the covariance, across time, between the average model errorℓ¯\(t\)\\bar\{\\ell\}\(t\)and the population\-level relative sampling density\|𝒯\|pT\(t\)\|\\mathcal\{T\}\|p\_\{T\}\(t\)\. If temporal regions with larger average errors have higher population\-level sampling densities, this term is positive; otherwise, it is negative\. WhenpT\(t\)=1/\|𝒯\|p\_\{T\}\(t\)=1/\|\\mathcal\{T\}\|, we haveGtime=0G\_\{\\mathrm\{time\}\}=0\. Therefore,GtimeG\_\{\\mathrm\{time\}\}characterizes the actual effect of population\-level temporal nonuniformity on the evaluation of the current model\. To estimate the above discrepancies in practice, we first estimate the marginal temporal density usingp^T\(t\)=1S∑r=1Sp^\(t∣Xr\)\\hat\{p\}\_\{T\}\(t\)=\\frac\{1\}\{S\}\\sum\_\{r=1\}^\{S\}\\hat\{p\}\(t\\mid X\_\{r\}\)\. We then usep^T\(t\)\\hat\{p\}\_\{T\}\(t\)as the target distribution to construct a self\-normalized importance\-sampling estimator ofRglobalR\_\{\\mathrm\{global\}\}, termed the Global\-Time Squared Error \(GSE\)\. Its detailed form is provided in the Appendix C\. The two discrepancy components can then be estimated as G^samp=MSE−GSE,G^time=GSE−CSE\.\\widehat\{G\}\_\{\\mathrm\{samp\}\}=\\mathrm\{MSE\}\-\\mathrm\{GSE\},\\qquad\\widehat\{G\}\_\{\\mathrm\{time\}\}=\\mathrm\{GSE\}\-\\mathrm\{CSE\}\.\(11\)This decomposition enables us to separately quantify the effects of sample\-dependent sampling and population\-level temporal nonuniformity on model scores and rankings in practice, providing a basis for analyzing evaluation discrepancies in the subsequent experiments\. ## 5Benchmark Protocol This section presents the benchmark setup, including the synthetic, semi\-synthetic, and real\-world datasets, representative baseline models, and unified training and evaluation protocols adopted to ensure fair and consistent comparisons\. ### 5\.1Datasets #### Synthetic and Semi\-Synthetic Data\. To obtain directly computable continuous\-time risks, we construct two fully synthetic datasets and two semi\-synthetic datasets\. Synthetic\-Regime gradually transitions from a smooth, low\-amplitude regime to a high\-frequency periodic regime, simulating a process whose forecasting difficulty varies substantially over time\. Synthetic\-Multiscale simultaneously contains trends, multiscale periodic patterns, and local transient variations, covering more complex temporal patterns\. Both fully synthetic datasets provide analytical continuous ground truth that can be queried at arbitrary future times\. The semi\-synthetic datasets are constructed from the regularly sampled ETTm1 and Weather datasets\([22](https://arxiv.org/html/2608.17293#bib.bib25)\)\. Specifically, we sample a finite number of historical and future timestamps from complete regular windows to form irregular samples, and use the equally weighted error over the complete future grid as the reference continuous\-time risk\. Training target times uniformly cover the future interval, whereas test timestamps are sampled from pα\(u\)=αBeta\(u,10,60\)\+\(1−α\)Uniform\(0,1\),p\_\{\\alpha\}\(u\)=\\alpha\\operatorname\{Beta\}\(u;10,60\)\+\(1\-\\alpha\)\\operatorname\{Uniform\}\(0,1\),\(12\)whereα∈\{0,0\.3,0\.5,0\.9,0\.99\}\\alpha\\in\\\{0,0\.3,0\.5,0\.9,0\.99\\\}controls the degree of temporal nonuniformity\. All sampling conditions share the same training data and model predictions, while only the test\-time distribution is varied, thereby isolating the effect of the evaluation protocol itself\. Detailed data\-generation procedures and window configurations are provided in the Appendix D\.1\. #### Real\-World Datasets\. We select eight real\-world irregular time series datasets spanning different application domains and sampling patterns\. USHCN contains long\-term climate observations from weather stations across the United States\([16](https://arxiv.org/html/2608.17293#bib.bib18)\)\. MIMIC\-III consists of sparse clinical records from ICU patients\([9](https://arxiv.org/html/2608.17293#bib.bib19)\)\. HumanActivity contains irregularly collected location\-sensor measurements recorded during human activities\([13](https://arxiv.org/html/2608.17293#bib.bib14)\)\. GDELT records multivariate event sequences triggered by international events\([12](https://arxiv.org/html/2608.17293#bib.bib26)\)\. RepoHealth describes software repository development activities, whose sampling frequency varies with project activity\([4](https://arxiv.org/html/2608.17293#bib.bib10)\)\. StudentLife contains mobile sensing data driven by user behavior and daily routines\([17](https://arxiv.org/html/2608.17293#bib.bib27)\)\. FNSPID consists of stock prices and trading information and exhibits structured temporal gaps induced by trading sessions\([4](https://arxiv.org/html/2608.17293#bib.bib10)\)\. CESNET contains traffic records generated by network devices, with timestamps affected by system scheduling delays and logging jitter\([4](https://arxiv.org/html/2608.17293#bib.bib10)\)\. For all datasets, we use only numerical time series and follow the corresponding public settings for preprocessing and data splitting\. Detailed dataset statistics, preprocessing procedures, and window configurations are provided in the Appendix D\.2\. ### 5\.2Baselines We select eleven representative irregular time series models covering different temporal modeling paradigms\. These include recurrent or continuous\-time models, namely GRU\-D and NeuralFlow\([5](https://arxiv.org/html/2608.17293#bib.bib12);[2](https://arxiv.org/html/2608.17293#bib.bib13)\); set\-, attention\-, or Transformer\-based models, including SeFT, mTAN, and Warpformer\([8](https://arxiv.org/html/2608.17293#bib.bib4);[20](https://arxiv.org/html/2608.17293#bib.bib5);[24](https://arxiv.org/html/2608.17293#bib.bib7)\); graph\- or hypergraph\-based models, including GraFITi, HyperIMTS, tPatchGNN, and ASTGI\([23](https://arxiv.org/html/2608.17293#bib.bib8);[13](https://arxiv.org/html/2608.17293#bib.bib14);[25](https://arxiv.org/html/2608.17293#bib.bib15);[14](https://arxiv.org/html/2608.17293#bib.bib24)\); and pre\-alignment and patch\-aggregation methods, including KAFNet and APN\([27](https://arxiv.org/html/2608.17293#bib.bib16);[15](https://arxiv.org/html/2608.17293#bib.bib17)\)\. Detailed descriptions and hyperparameter configurations for all models are provided in the Appendix D\.3\. ### 5\.3Training and Evaluation Protocol All models use the same data splits and input information, and their training objective is uniformly set to the MSE over observed timestamps\. The remaining training and hyperparameter settings follow the corresponding public implementations, with model selection performed according to validation MSE\. In each independent run, every model produces only one set of test predictions, on which MSE, GSE, and CSE are computed\. This ensures that the differences among the metrics arise solely from the temporal weighting applied during test\-time evaluation\. Both the conditional and marginal temporal densities are estimated exclusively from the test timestamps and are shared across all models on the same dataset\. We further computeG^samp\\widehat\{G\}\_\{\\mathrm\{samp\}\}andG^time\\widehat\{G\}\_\{\\mathrm\{time\}\}to analyze the sources of evaluation discrepancies\. All experiments are independently repeated using five random seeds\. The main text reports the mean results, while complete results with standard deviations are provided in the Appendix\. Detailed training configurations, density\-estimation parameters, and other implementation details are also provided in the Appendix D\.4\. ## 6Experiments Using the proposed benchmark, we conduct experiments to investigate three questions: \(1\) Can CSE recover continuous\-time risk and model rankings more accurately than MSE under non\-uniform sampling? \(2\) Does observation\-point MSE fully reflect models’ continuous\-time predictive performance on real\-world datasets? \(3\) How do the sampling\-dependence and temporal\-distribution gaps influence MSE–CSE discrepancies? ### 6\.1Can CSE Better Recover Continuous\-Time Risk and Rankings than MSE? In this section, we evaluate the ability of CSE to recover continuous\-time risks and model rankings in controlled environments with complete future ground truth\. The experiments include two fully synthetic datasets and two semi\-synthetic datasets, and consider five representative models: SeFT, GRU\-D, GraFITi, tPatchGNN, and KAFNet\. For the fully synthetic datasets, we computeRctR\_\{\\mathrm\{ct\}\}through dense temporal integration\. For the semi\-synthetic datasets, we compute the reference risk over the complete regular future grid\. The main text reports the results on Synthetic\-Regime and Weather, while the remaining results are provided in the Appendix E\.1\. Table 1:Forecasting performance under MSE and CSE on eight real\-world datasets\. Superscripts denote ranks\. The best and second\-best results are highlighted in bold and underlined, respectively\.CESNET×10−1\\times 10^\{\-1\}FNSPID×10−1\\times 10^\{\-1\}GDELT×100\\times 10^\{0\}HumanActivity×10−2\\times 10^\{\-2\}MIMIC\-III×10−1\\times 10^\{\-1\}RepoHealth×10−1\\times 10^\{\-1\}StudentLife×10−1\\times 10^\{\-1\}USHCN×10−1\\times 10^\{\-1\}AverageModelMSECSEMSECSEMSECSEMSECSEMSECSEMSECSEMSECSEMSECSERankAPN8\.76\(5\)8\.76^\{\\scriptscriptstyle\(5\)\}8\.58\(5\)8\.58^\{\\scriptscriptstyle\(5\)\}2\.38¯\(2\)\\underline\{2\.38\}^\{\\scriptscriptstyle\(2\)\}2\.38¯\(2\)\\underline\{2\.38\}^\{\\scriptscriptstyle\(2\)\}1\.02\(1\)\\mathbf\{1\.02\}^\{\\scriptscriptstyle\(1\)\}0\.99\(1\)\\mathbf\{0\.99\}^\{\\scriptscriptstyle\(1\)\}5\.68\(6\)5\.68^\{\\scriptscriptstyle\(6\)\}5\.65\(6\)5\.65^\{\\scriptscriptstyle\(6\)\}6\.66\(6\)6\.66^\{\\scriptscriptstyle\(6\)\}6\.72\(6\)6\.72^\{\\scriptscriptstyle\(6\)\}3\.36¯\(2\)\\underline\{3\.36\}^\{\\scriptscriptstyle\(2\)\}3\.57\(1\)\\mathbf\{3\.57\}^\{\\scriptscriptstyle\(1\)\}6\.61¯\(2\)\\underline\{6\.61\}^\{\\scriptscriptstyle\(2\)\}6\.68\(3\)6\.68^\{\\scriptscriptstyle\(3\)\}6\.04\(4\)6\.04^\{\\scriptscriptstyle\(4\)\}6\.71\(5\)6\.71^\{\\scriptscriptstyle\(5\)\}3\.6¯\\underline\{3\.6\}ASTGI8\.47\(1\)\\mathbf\{8\.47\}^\{\\scriptscriptstyle\(1\)\}8\.26\(1\)\\mathbf\{8\.26\}^\{\\scriptscriptstyle\(1\)\}3\.28\(6\)3\.28^\{\\scriptscriptstyle\(6\)\}3\.25\(6\)3\.25^\{\\scriptscriptstyle\(6\)\}1\.10\(4\)1\.10^\{\\scriptscriptstyle\(4\)\}1\.04\(4\)1\.04^\{\\scriptscriptstyle\(4\)\}5\.46\(3\)5\.46^\{\\scriptscriptstyle\(3\)\}5\.41\(3\)5\.41^\{\\scriptscriptstyle\(3\)\}10\.50\(11\)10\.50^\{\\scriptscriptstyle\(11\)\}10\.62\(11\)10\.62^\{\\scriptscriptstyle\(11\)\}6\.27\(7\)6\.27^\{\\scriptscriptstyle\(7\)\}6\.53\(7\)6\.53^\{\\scriptscriptstyle\(7\)\}6\.65\(3\)6\.65^\{\\scriptscriptstyle\(3\)\}6\.65¯\(2\)\\underline\{6\.65\}^\{\\scriptscriptstyle\(2\)\}5\.14\(3\)5\.14^\{\\scriptscriptstyle\(3\)\}5\.66\(3\)5\.66^\{\\scriptscriptstyle\(3\)\}4\.74\.7GRU\-D10\.22\(10\)10\.22^\{\\scriptscriptstyle\(10\)\}9\.91\(10\)9\.91^\{\\scriptscriptstyle\(10\)\}5\.24\(8\)5\.24^\{\\scriptscriptstyle\(8\)\}5\.20\(8\)5\.20^\{\\scriptscriptstyle\(8\)\}1\.22\(10\)1\.22^\{\\scriptscriptstyle\(10\)\}1\.15\(10\)1\.15^\{\\scriptscriptstyle\(10\)\}8\.56\(9\)8\.56^\{\\scriptscriptstyle\(9\)\}8\.56\(9\)8\.56^\{\\scriptscriptstyle\(9\)\}6\.67\(7\)6\.67^\{\\scriptscriptstyle\(7\)\}6\.75\(7\)6\.75^\{\\scriptscriptstyle\(7\)\}11\.68\(11\)11\.68^\{\\scriptscriptstyle\(11\)\}11\.95\(11\)11\.95^\{\\scriptscriptstyle\(11\)\}7\.21\(8\)7\.21^\{\\scriptscriptstyle\(8\)\}7\.23\(8\)7\.23^\{\\scriptscriptstyle\(8\)\}7\.78\(11\)7\.78^\{\\scriptscriptstyle\(11\)\}8\.59\(11\)8\.59^\{\\scriptscriptstyle\(11\)\}9\.39\.3GraFITi8\.50¯\(2\)\\underline\{8\.50\}^\{\\scriptscriptstyle\(2\)\}8\.28¯\(2\)\\underline\{8\.28\}^\{\\scriptscriptstyle\(2\)\}3\.21\(4\)3\.21^\{\\scriptscriptstyle\(4\)\}3\.22\(4\)3\.22^\{\\scriptscriptstyle\(4\)\}1\.09\(3\)1\.09^\{\\scriptscriptstyle\(3\)\}1\.01¯\(2\)\\underline\{1\.01\}^\{\\scriptscriptstyle\(2\)\}5\.44¯\(2\)\\underline\{5\.44\}^\{\\scriptscriptstyle\(2\)\}5\.40¯\(2\)\\underline\{5\.40\}^\{\\scriptscriptstyle\(2\)\}5\.89\(1\)\\mathbf\{5\.89\}^\{\\scriptscriptstyle\(1\)\}6\.02¯\(2\)\\underline\{6\.02\}^\{\\scriptscriptstyle\(2\)\}3\.32\(1\)\\mathbf\{3\.32\}^\{\\scriptscriptstyle\(1\)\}3\.61¯\(2\)\\underline\{3\.61\}^\{\\scriptscriptstyle\(2\)\}6\.72\(6\)6\.72^\{\\scriptscriptstyle\(6\)\}6\.70\(4\)6\.70^\{\\scriptscriptstyle\(4\)\}4\.50\(1\)\\mathbf\{4\.50\}^\{\\scriptscriptstyle\(1\)\}4\.89\(1\)\\mathbf\{4\.89\}^\{\\scriptscriptstyle\(1\)\}2\.4\\mathbf\{2\.4\}HyperIMTS8\.90\(7\)8\.90^\{\\scriptscriptstyle\(7\)\}8\.65\(7\)8\.65^\{\\scriptscriptstyle\(7\)\}2\.72\(3\)2\.72^\{\\scriptscriptstyle\(3\)\}2\.71\(3\)2\.71^\{\\scriptscriptstyle\(3\)\}1\.18\(8\)1\.18^\{\\scriptscriptstyle\(8\)\}1\.09\(8\)1\.09^\{\\scriptscriptstyle\(8\)\}5\.42\(1\)\\mathbf\{5\.42\}^\{\\scriptscriptstyle\(1\)\}5\.38\(1\)\\mathbf\{5\.38\}^\{\\scriptscriptstyle\(1\)\}5\.94¯\(2\)\\underline\{5\.94\}^\{\\scriptscriptstyle\(2\)\}5\.92\(1\)\\mathbf\{5\.92\}^\{\\scriptscriptstyle\(1\)\}3\.72\(3\)3\.72^\{\\scriptscriptstyle\(3\)\}3\.97\(3\)3\.97^\{\\scriptscriptstyle\(3\)\}6\.54\(1\)\\mathbf\{6\.54\}^\{\\scriptscriptstyle\(1\)\}6\.56\(1\)\\mathbf\{6\.56\}^\{\\scriptscriptstyle\(1\)\}6\.67\(8\)6\.67^\{\\scriptscriptstyle\(8\)\}7\.30\(8\)7\.30^\{\\scriptscriptstyle\(8\)\}4\.14\.1KAFNet8\.73\(4\)8\.73^\{\\scriptscriptstyle\(4\)\}8\.54\(4\)8\.54^\{\\scriptscriptstyle\(4\)\}2\.23\(1\)\\mathbf\{2\.23\}^\{\\scriptscriptstyle\(1\)\}2\.22\(1\)\\mathbf\{2\.22\}^\{\\scriptscriptstyle\(1\)\}1\.08¯\(2\)\\underline\{1\.08\}^\{\\scriptscriptstyle\(2\)\}1\.02\(3\)1\.02^\{\\scriptscriptstyle\(3\)\}5\.62\(4\)5\.62^\{\\scriptscriptstyle\(4\)\}5\.58\(4\)5\.58^\{\\scriptscriptstyle\(4\)\}6\.41\(3\)6\.41^\{\\scriptscriptstyle\(3\)\}6\.47\(3\)6\.47^\{\\scriptscriptstyle\(3\)\}5\.72\(6\)5\.72^\{\\scriptscriptstyle\(6\)\}5\.98\(6\)5\.98^\{\\scriptscriptstyle\(6\)\}6\.66\(4\)6\.66^\{\\scriptscriptstyle\(4\)\}6\.72\(5\)6\.72^\{\\scriptscriptstyle\(5\)\}7\.14\(9\)7\.14^\{\\scriptscriptstyle\(9\)\}7\.82\(9\)7\.82^\{\\scriptscriptstyle\(9\)\}4\.34\.3NeuralFlow9\.98\(8\)9\.98^\{\\scriptscriptstyle\(8\)\}9\.69\(8\)9\.69^\{\\scriptscriptstyle\(8\)\}7\.33\(10\)7\.33^\{\\scriptscriptstyle\(10\)\}7\.29\(10\)7\.29^\{\\scriptscriptstyle\(10\)\}1\.18\(9\)1\.18^\{\\scriptscriptstyle\(9\)\}1\.09\(9\)1\.09^\{\\scriptscriptstyle\(9\)\}17\.53\(11\)17\.53^\{\\scriptscriptstyle\(11\)\}17\.51\(11\)17\.51^\{\\scriptscriptstyle\(11\)\}7\.05\(8\)7\.05^\{\\scriptscriptstyle\(8\)\}7\.19\(9\)7\.19^\{\\scriptscriptstyle\(9\)\}10\.13\(10\)10\.13^\{\\scriptscriptstyle\(10\)\}10\.44\(10\)10\.44^\{\\scriptscriptstyle\(10\)\}7\.83\(10\)7\.83^\{\\scriptscriptstyle\(10\)\}7\.86\(10\)7\.86^\{\\scriptscriptstyle\(10\)\}6\.07\(5\)6\.07^\{\\scriptscriptstyle\(5\)\}6\.74\(6\)6\.74^\{\\scriptscriptstyle\(6\)\}9\.09\.0SeFT10\.11\(9\)10\.11^\{\\scriptscriptstyle\(9\)\}9\.79\(9\)9\.79^\{\\scriptscriptstyle\(9\)\}8\.70\(11\)8\.70^\{\\scriptscriptstyle\(11\)\}8\.66\(11\)8\.66^\{\\scriptscriptstyle\(11\)\}1\.13\(6\)1\.13^\{\\scriptscriptstyle\(6\)\}1\.05\(5\)1\.05^\{\\scriptscriptstyle\(5\)\}9\.38\(10\)9\.38^\{\\scriptscriptstyle\(10\)\}9\.36\(10\)9\.36^\{\\scriptscriptstyle\(10\)\}7\.10\(9\)7\.10^\{\\scriptscriptstyle\(9\)\}7\.15\(8\)7\.15^\{\\scriptscriptstyle\(8\)\}9\.13\(8\)9\.13^\{\\scriptscriptstyle\(8\)\}9\.44\(8\)9\.44^\{\\scriptscriptstyle\(8\)\}8\.94\(11\)8\.94^\{\\scriptscriptstyle\(11\)\}8\.95\(11\)8\.95^\{\\scriptscriptstyle\(11\)\}7\.64\(10\)7\.64^\{\\scriptscriptstyle\(10\)\}8\.41\(10\)8\.41^\{\\scriptscriptstyle\(10\)\}9\.19\.1Warpformer8\.58\(3\)8\.58^\{\\scriptscriptstyle\(3\)\}8\.37\(3\)8\.37^\{\\scriptscriptstyle\(3\)\}3\.66\(7\)3\.66^\{\\scriptscriptstyle\(7\)\}3\.63\(7\)3\.63^\{\\scriptscriptstyle\(7\)\}1\.30\(11\)1\.30^\{\\scriptscriptstyle\(11\)\}1\.20\(11\)1\.20^\{\\scriptscriptstyle\(11\)\}5\.65\(5\)5\.65^\{\\scriptscriptstyle\(5\)\}5\.61\(5\)5\.61^\{\\scriptscriptstyle\(5\)\}6\.42\(4\)6\.42^\{\\scriptscriptstyle\(4\)\}6\.50\(5\)6\.50^\{\\scriptscriptstyle\(5\)\}5\.04\(5\)5\.04^\{\\scriptscriptstyle\(5\)\}5\.33\(5\)5\.33^\{\\scriptscriptstyle\(5\)\}6\.78\(7\)6\.78^\{\\scriptscriptstyle\(7\)\}6\.80\(7\)6\.80^\{\\scriptscriptstyle\(7\)\}6\.13\(6\)6\.13^\{\\scriptscriptstyle\(6\)\}6\.67\(4\)6\.67^\{\\scriptscriptstyle\(4\)\}5\.95\.9mTAN10\.47\(11\)10\.47^\{\\scriptscriptstyle\(11\)\}10\.14\(11\)10\.14^\{\\scriptscriptstyle\(11\)\}6\.13\(9\)6\.13^\{\\scriptscriptstyle\(9\)\}6\.09\(9\)6\.09^\{\\scriptscriptstyle\(9\)\}1\.12\(5\)1\.12^\{\\scriptscriptstyle\(5\)\}1\.05\(6\)1\.05^\{\\scriptscriptstyle\(6\)\}7\.33\(8\)7\.33^\{\\scriptscriptstyle\(8\)\}7\.30\(8\)7\.30^\{\\scriptscriptstyle\(8\)\}7\.47\(10\)7\.47^\{\\scriptscriptstyle\(10\)\}7\.54\(10\)7\.54^\{\\scriptscriptstyle\(10\)\}10\.09\(9\)10\.09^\{\\scriptscriptstyle\(9\)\}10\.39\(9\)10\.39^\{\\scriptscriptstyle\(9\)\}7\.32\(9\)7\.32^\{\\scriptscriptstyle\(9\)\}7\.34\(9\)7\.34^\{\\scriptscriptstyle\(9\)\}4\.84¯\(2\)\\underline\{4\.84\}^\{\\scriptscriptstyle\(2\)\}5\.23¯\(2\)\\underline\{5\.23\}^\{\\scriptscriptstyle\(2\)\}7\.97\.9tPatchGNN8\.86\(6\)8\.86^\{\\scriptscriptstyle\(6\)\}8\.61\(6\)8\.61^\{\\scriptscriptstyle\(6\)\}3\.26\(5\)3\.26^\{\\scriptscriptstyle\(5\)\}3\.24\(5\)3\.24^\{\\scriptscriptstyle\(5\)\}1\.15\(7\)1\.15^\{\\scriptscriptstyle\(7\)\}1\.08\(7\)1\.08^\{\\scriptscriptstyle\(7\)\}5\.80\(7\)5\.80^\{\\scriptscriptstyle\(7\)\}5\.76\(7\)5\.76^\{\\scriptscriptstyle\(7\)\}6\.44\(5\)6\.44^\{\\scriptscriptstyle\(5\)\}6\.48\(4\)6\.48^\{\\scriptscriptstyle\(4\)\}4\.55\(4\)4\.55^\{\\scriptscriptstyle\(4\)\}4\.82\(4\)4\.82^\{\\scriptscriptstyle\(4\)\}6\.68\(5\)6\.68^\{\\scriptscriptstyle\(5\)\}6\.73\(6\)6\.73^\{\\scriptscriptstyle\(6\)\}6\.36\(7\)6\.36^\{\\scriptscriptstyle\(7\)\}7\.05\(7\)7\.05^\{\\scriptscriptstyle\(7\)\}5\.85\.8 Fig\.[4](https://arxiv.org/html/2608.17293#S6.F4)\(a\) and Fig\.[4](https://arxiv.org/html/2608.17293#S6.F4)\(b\) show the estimation errors of MSE and CSE with respect toRctR\_\{\\mathrm\{ct\}\}\. Under uniform sampling, both metrics accurately recover the continuous\-time risk\. Asα\\alphaincreases, the test\-time distribution progressively deviates from the uniform distribution, causing the discrepancy between MSE andRctR\_\{\\mathrm\{ct\}\}to increase consistently, whereas CSE maintains a substantially lower estimation error\. For example, whenα=0\.9\\alpha=0\.9, the relative errors of MSE and CSE on Synthetic\-Regime are80\.6%80\.6\\%and34\.7%34\.7\\%, respectively\. Under the more extreme setting ofα=0\.99\\alpha=0\.99, although the error of CSE increases, it remains substantially lower than that of MSE\. To further assess the recovery of model rankings, Table[2](https://arxiv.org/html/2608.17293#S6.T2)compares the evaluation results of the five models underα=0\.9\\alpha=0\.9\. On both Synthetic\-Regime and Weather, CSE recovers exactly the same ranking of all five models asRctR\_\{\\mathrm\{ct\}\}, whereas MSE produces a different ranking on both datasets\. Overall, CSE effectively mitigates the influence of non\-uniform test sampling on model evaluation\. Across both synthetic and semi\-synthetic datasets, CSE recovers continuous\-time risk and model rankings more accurately than MSE, validating its effectiveness as a continuous\-time evaluation metric\. Table 2:Model evaluation under non\-uniform test sampling withα=0\.9\\alpha=0\.9\. Superscripts denote ranks; the best and second\-best results are highlighted in bold and underlined, respectively\.Synthetic\-Regime×10−2\\times 10^\{\-2\}Weather×10−1\\times 10^\{\-1\}ModelMSECSERctR\_\{\\mathrm\{ct\}\}MSECSERctR\_\{\\mathrm\{ct\}\}SeFT1\.09\(3\)1\.09^\{\\scriptscriptstyle\(3\)\}8\.70\(1\)\\mathbf\{8\.70\}^\{\\scriptscriptstyle\(1\)\}6\.26\(1\)\\mathbf\{6\.26\}^\{\\scriptscriptstyle\(1\)\}4\.40\(5\)4\.40^\{\\scriptscriptstyle\(5\)\}4\.96\(5\)4\.96^\{\\scriptscriptstyle\(5\)\}4\.85\(5\)4\.85^\{\\scriptscriptstyle\(5\)\}GRU\-D0\.65\(1\)\\mathbf\{0\.65\}^\{\\scriptscriptstyle\(1\)\}8\.81¯\(2\)\\underline\{8\.81\}^\{\\scriptscriptstyle\(2\)\}6\.48¯\(2\)\\underline\{6\.48\}^\{\\scriptscriptstyle\(2\)\}3\.08\(1\)\\mathbf\{3\.08\}^\{\\scriptscriptstyle\(1\)\}4\.61\(3\)4\.61^\{\\scriptscriptstyle\(3\)\}4\.46\(3\)4\.46^\{\\scriptscriptstyle\(3\)\}GraFITi2\.57\(5\)2\.57^\{\\scriptscriptstyle\(5\)\}9\.88\(5\)9\.88^\{\\scriptscriptstyle\(5\)\}7\.66\(5\)7\.66^\{\\scriptscriptstyle\(5\)\}3\.89\(4\)3\.89^\{\\scriptscriptstyle\(4\)\}4\.92\(4\)4\.92^\{\\scriptscriptstyle\(4\)\}4\.76\(4\)4\.76^\{\\scriptscriptstyle\(4\)\}tPatchGNN0\.91¯\(2\)\\underline\{0\.91\}^\{\\scriptscriptstyle\(2\)\}9\.38\(4\)9\.38^\{\\scriptscriptstyle\(4\)\}6\.91\(4\)6\.91^\{\\scriptscriptstyle\(4\)\}3\.88\(3\)3\.88^\{\\scriptscriptstyle\(3\)\}3\.69\(1\)\\mathbf\{3\.69\}^\{\\scriptscriptstyle\(1\)\}3\.53\(1\)\\mathbf\{3\.53\}^\{\\scriptscriptstyle\(1\)\}KAFNet1\.54\(4\)1\.54^\{\\scriptscriptstyle\(4\)\}9\.04\(3\)9\.04^\{\\scriptscriptstyle\(3\)\}6\.75\(3\)6\.75^\{\\scriptscriptstyle\(3\)\}3\.48¯\(2\)\\underline\{3\.48\}^\{\\scriptscriptstyle\(2\)\}3\.78¯\(2\)\\underline\{3\.78\}^\{\\scriptscriptstyle\(2\)\}3\.65¯\(2\)\\underline\{3\.65\}^\{\\scriptscriptstyle\(2\)\} \(a\)Sampling\-dependence gapG^samp\\widehat\{G\}\_\{\\mathrm\{samp\}\} \(b\)Temporal\-distribution gapG^time\\widehat\{G\}\_\{\\mathrm\{time\}\} Figure 2:Normalized decomposition of the evaluation discrepancy into the sampling\-dependence gapG^samp\\widehat\{G\}\_\{\\mathrm\{samp\}\}and temporal\-distribution gapG^time\\widehat\{G\}\_\{\\mathrm\{time\}\}across models and datasets\. ### 6\.2Does MSE Fully Reflect Continuous\-Time Predictive Performance on Real\-World Data? The previous section shows that CSE more accurately recovers continuous\-time risk and model rankings when the underlying future trajectory is available\. We now examine whether observation\-point MSE provides a sufficient evaluation of models’ continuous\-time predictive performance on real\-world datasets, where the complete continuous trajectory is unavailable\. Table[1](https://arxiv.org/html/2608.17293#S6.T1)reports the results of 11 models on eight datasets, while Fig\.[3](https://arxiv.org/html/2608.17293#S6.F3)summarizes pairwise rank inversions and changes in the selection of the best\-performing model\. Comparisons between MAE and CAE, together with complete results including standard deviations, are provided in the Appendix E\.2\. The comparison shows that CSE is not a fixed\-direction or fixed\-ratio correction of MSE\. The direction and magnitude of score changes vary across both datasets and models, indicating that the two metrics cannot be converted through simple rescaling\. Moreover, five of the eight datasets exhibit pairwise rank inversions when replacing MSE with CSE\. MIMIC\-III and StudentLife each contain three inversions, GDELT and USHCN each contain two, and RepoHealth contains one\. The best\-performing model also changes on MIMIC\-III and RepoHealth\. The effects further differ across models\. GraFITi ranks first on three datasets under MSE but on only one dataset under CSE\. In contrast, the number of first\-place rankings increases from two to three for HyperIMTS and from one to two for APN\. Although GraFITi retains the best average rank, MSE and CSE do not provide fully consistent conclusions regarding the relative advantages of different models\. Overall, the substantial discrepancies in model scores, rankings, and model selection suggest that relying solely on observation\-point MSE may not fully reflect models’ continuous\-time predictive performance on real\-world datasets\. \(a\)Pairwise rank inversions across datasets\(b\)Changes in Top\-1 model selection Figure 3:Model ranking changes when replacing MSE with CSE on eight real\-world datasets\. Panel \(a\) reports the number of pairwise rank inversions, while Panel \(b\) compares the frequency with which each model is ranked first\. ### 6\.3How Do the Sampling\-Dependence and Temporal\-Distribution Gaps Influence MSE–CSE Discrepancies? The previous section demonstrates that MSE and CSE can produce different model scores, rankings, and model selections on real\-world datasets\. We now use the risk decomposition introduced above to analyze the sources of these discrepancies\. Fig\.[2](https://arxiv.org/html/2608.17293#S6.F2)reports the normalized sampling\-dependence gap,G^samp=\(MSE−GSE\)/MSE\\widehat\{G\}\_\{\\mathrm\{samp\}\}=\(\\mathrm\{MSE\}\-\\mathrm\{GSE\}\)/\\mathrm\{MSE\}, and the normalized temporal\-distribution gap,G^time=\(GSE−CSE\)/GSE\\widehat\{G\}\_\{\\mathrm\{time\}\}=\(\\mathrm\{GSE\}\-\\mathrm\{CSE\}\)/\\mathrm\{GSE\}\. The relative contributions of the two gaps vary substantially across datasets\. GDELT and RepoHealth are primarily affected by the sampling\-dependence gap, whose cross\-model averages are approximately5\.9%5\.9\\%and−5\.8%\-5\.8\\%, respectively\. CESNET is mainly affected by the temporal\-distribution gap, with an average value of approximately3\.3%3\.3\\%\. On USHCN, the sampling\-dependence and temporal\-distribution gaps are approximately−7\.8%\-7\.8\\%and−2\.2%\-2\.2\\%, respectively, indicating that both components contribute to the discrepancy between MSE and CSE\. The two gaps are comparatively small on the remaining datasets\. Within the same dataset, models generally exhibit similar signs for each discrepancy component, suggesting that the overall direction is largely determined by the dataset’s sampling structure\. However, the magnitude varies across models because of their different temporal error patterns\. This model\-dependent effect can alter model rankings when the original performance differences are small\. For example, on MIMIC\-III, the sampling\-dependence gaps of GraFITi and HyperIMTS are−2\.2%\-2\.2\\%and\+0\.8%\+0\.8\\%, respectively, changing the best\-performing model from GraFITi under MSE to HyperIMTS under CSE\. On RepoHealth, GraFITi exhibits a more negative sampling\-dependence gap than APN, giving it a larger apparent advantage under MSE; this advantage disappears under CSE, making APN the best\-performing model\. \(a\)Synthetic\-Regime\(b\)Weather Figure 4:Relative errors of MSE and CSE with respect toRctR\_\{\\mathrm\{ct\}\}under increasing sampling non\-uniformity\.Overall, the discrepancies between MSE and CSE are jointly influenced by the sampling\-dependence and temporal\-distribution gaps, whose relative contributions vary across datasets and models\. ## 7Conclusion This work revisits the evaluation of irregular time series forecasting from a continuous\-time perspective\. We show that observation\-point MSE and MAE effectively estimate the observation\-distribution risk induced by the sampling distribution, rather than the continuous\-time risk over the entire future interval\. To mitigate this objective mismatch, we propose the Continuous\-Time Squared Error \(CSE\), which estimates the continuous\-time risk through self\-normalized importance weighting, and prove that its asymptotic estimation error is no greater than that of MSE\. We further decompose the discrepancy between the two risks into a sampling\-dependence gap and a temporal\-distribution gap, thereby characterizing how different sampling structures affect model evaluation\. Finally, we construct a benchmark covering synthetic, semi\-synthetic, and real\-world datasets to validate CSE and systematically evaluate models’ continuous\-time predictive performance\. ## References - E\. Afrifa\-Yamoah, U\. A\. Mueller, S\. M\. Taylor, and A\. J\. FisherMissing data imputation of high\-resolution temporal climate time series data\.Meteorological Applications27\(1\),pp\. e1873\.Cited by:[§1](https://arxiv.org/html/2608.17293#S1.p1.1)\. - Biloset al\.\(2021\)M\. Bilos, J\. Sommer, S\. S\. Rangapuram, T\. Januschowski, and S\. GünnemannNeural flows: efficient alternative to neural ODEs\.InAdvances in Neural Information Processing Systems,pp\. 21325–21337\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px7.p1.1),[§1](https://arxiv.org/html/2608.17293#S1.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Buiet al\.\(2024\)H\. Bui, H\. Warrier, and Y\. GuptaBenchmarking with MIMIC\-IV, an irregular, spare clinical time series dataset\.arXiv preprint arXiv:2401\.15290\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2401.15290)Cited by:[§2\.2](https://arxiv.org/html/2608.17293#S2.SS2.p1.1)\. - Changet al\.\(2025\)C\. Chang, J\. Hwang, Y\. Shi, H\. Wang, W\. Peng, T\. Chen, and W\. WangTime\-IMM: a dataset and benchmark for irregular multimodal multivariate time series\.CoRRabs/2506\.10412\.Cited by:[§D\.2](https://arxiv.org/html/2608.17293#A4.SS2.p1.1),[§2\.2](https://arxiv.org/html/2608.17293#S2.SS2.p1.1),[§5\.1](https://arxiv.org/html/2608.17293#S5.SS1.SSS0.Px2.p1.1)\. - Cheet al\.\(2016\)Z\. Che, S\. Purushotham, K\. Cho, D\. A\. Sontag, and Y\. LiuRecurrent neural networks for multivariate time series with missing values\.CoRRabs/1606\.01865\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px3.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Decorteet al\.\(2024\)T\. Decorte, S\. Mortier, J\. J\. Lembrechts, F\. J\. R\. Meysman, S\. Latré, E\. Mannens, and T\. VerdonckMissing value imputation of wireless sensor data for environmental monitoring\.Sensors24\(8\),pp\. 2416\.Cited by:[§1](https://arxiv.org/html/2608.17293#S1.p1.1)\. - Ghassemiet al\.\(2015\)M\. Ghassemi, M\. A\. F\. Pimentel, T\. Naumann, T\. Brennan, D\. A\. Clifton, P\. Szolovits, and M\. FengA multivariate timeseries modeling approach to severity of illness assessment and forecasting in ICU with sparse, heterogeneous clinical data\.InProceedings of the Twenty\-Ninth AAAI Conference on Artificial Intelligence, January 25\-30, 2015, Austin, Texas, USA,pp\. 446–453\.Cited by:[§1](https://arxiv.org/html/2608.17293#S1.p1.1)\. - Hornet al\.\(2020\)M\. Horn, M\. Moor, C\. Bock, B\. Rieck, and K\. M\. BorgwardtSet functions for time series\.InInternational Conference on Machine Learning,pp\. 4353–4363\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px8.p1.1),[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Johnsonet al\.\(2016\)A\. E\. W\. Johnson, T\. J\. Pollard, L\. Shen, L\. H\. Lehman, M\. Feng, M\. Ghassemi, B\. Moody, P\. Szolovits, L\. A\. Celi, and R\. G\. MarkMIMIC\-III, a freely accessible critical care database\.Scientific Data3,pp\. 160035\.External Links:[Document](https://dx.doi.org/10.1038/sdata.2016.35)Cited by:[§D\.2](https://arxiv.org/html/2608.17293#A4.SS2.SSS0.Px5.p1.1),[§5\.1](https://arxiv.org/html/2608.17293#S5.SS1.SSS0.Px2.p1.1)\. - Kidgeret al\.\(2020\)P\. Kidger, J\. Morrill, J\. Foster, and T\. J\. LyonsNeural controlled differential equations for irregular time series\.InAdvances in Neural Information Processing Systems,Cited by:[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1)\. - Klötergenset al\.\(2025\)C\. Klötergens, V\. K\. Yalavarthi, R\. Scholz, M\. Stubbemann, S\. Born, and L\. Schmidt\-ThiemePhysiome\-ODE: a benchmark for irregularly sampled multivariate time\-series forecasting based on biological ODEs\.InInternational Conference on Learning Representations,Cited by:[§2\.2](https://arxiv.org/html/2608.17293#S2.SS2.p1.1),[§2\.2](https://arxiv.org/html/2608.17293#S2.SS2.p2.1)\. - Leetaru and Schrodt \(2013\)K\. Leetaru and P\. A\. SchrodtGDELT: global data on events, location, and tone\.ISA Annual Convention\.Cited by:[§5\.1](https://arxiv.org/html/2608.17293#S5.SS1.SSS0.Px2.p1.1)\. - Liet al\.\(2025\)B\. Li, Y\. Luo, Z\. Liu, J\. Zheng, J\. Lv, and Q\. MaHyperIMTS: hypergraph neural network for irregular multivariate time series forecasting\.InInternational Conference on Machine Learning,pp\. 35502–35518\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px5.p1.1),[§5\.1](https://arxiv.org/html/2608.17293#S5.SS1.SSS0.Px2.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Liuet al\.\(2026a\)X\. Liu, X\. Qiu, H\. Cheng, X\. Wu, C\. Guo, B\. Yang, and J\. HuASTGI: adaptive spatio\-temporal graph interactions for irregular multivariate time series forecasting\.InInternational Conference on Learning Representations,Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px2.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Liuet al\.\(2026b\)X\. Liu, X\. Qiu, X\. Wu, Z\. Li, C\. Guo, J\. Hu, and B\. YangRethinking irregular time series forecasting: a simple yet effective baseline\.InAAAI Conference on Artificial Intelligence,pp\. 23873–23881\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px1.p1.1),[§1](https://arxiv.org/html/2608.17293#S1.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Menneet al\.\(2015\)M\. J\. Menne, C\. N\. Jr\. Williams, and R\. S\. VoseLong\-term daily and monthly climate records from stations across the contiguous united states \(u\.s\. historical climatology network\)\.Note:Environmental System Science Data Infrastructure for a Virtual Ecosystem \(ESS\-DIVE\)Cited by:[§D\.2](https://arxiv.org/html/2608.17293#A4.SS2.SSS0.Px8.p1.1),[§5\.1](https://arxiv.org/html/2608.17293#S5.SS1.SSS0.Px2.p1.1)\. - Nepalet al\.\(2024\)S\. Nepal, W\. Liu, A\. Pillai, W\. Wang, V\. Vojdanovski, J\. F\. Huckins, C\. Rogers, M\. L\. Meyer, and A\. T\. CampbellCapturing the college experience: a four\-year mobile sensing study of mental health, resilience and behavior of college students during the pandemic\.Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies8\(1\),pp\. 1–37\.Cited by:[§5\.1](https://arxiv.org/html/2608.17293#S5.SS1.SSS0.Px2.p1.1)\. - Rubanovaet al\.\(2019\)Y\. Rubanova, T\. Q\. Chen, and D\. DuvenaudLatent ordinary differential equations for irregularly\-sampled time series\.InAdvances in Neural Information Processing Systems,pp\. 5321–5331\.Cited by:[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1)\. - Schirmeret al\.\(2022\)M\. Schirmer, M\. Eltayeb, S\. Lessmann, and M\. RudolphModeling irregular time series with continuous recurrent units\.InInternational Conference on Machine Learning,pp\. 19388–19405\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px12.p1.1),[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1)\. - Shukla and Marlin \(2021\)S\. N\. Shukla and B\. M\. MarlinMulti\-time attention networks for irregularly sampled time series\.InInternational Conference on Learning Representations,Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px10.p1.1),[§1](https://arxiv.org/html/2608.17293#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Spinnato and Landi \(2025\)F\. Spinnato and C\. LandiPYRREGULAR: a unified framework for irregular time series, with classification benchmarks\.CoRRabs/2505\.06047\.Cited by:[§2\.2](https://arxiv.org/html/2608.17293#S2.SS2.p1.1)\. - Wuet al\.\(2021\)H\. Wu, J\. Xu, J\. Wang, and M\. LongAutoformer: decomposition transformers with auto\-correlation for long\-term series forecasting\.InAdvances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6\-14, 2021, virtual,pp\. 22419–22430\.Cited by:[§5\.1](https://arxiv.org/html/2608.17293#S5.SS1.SSS0.Px1.p1.1)\. - Yalavarthiet al\.\(2024\)V\. K\. Yalavarthi, K\. Madhusudhanan, R\. Scholz, N\. Ahmed, J\. Burchert, S\. Jawed, S\. Born, and L\. Schmidt\-ThiemeGraFITi: graphs for forecasting irregularly sampled time series\.InAAAI Conference on Artificial Intelligence,pp\. 16255–16263\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px4.p1.1),[§1](https://arxiv.org/html/2608.17293#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Zhanget al\.\(2023\)J\. Zhang, S\. Zheng, W\. Cao, J\. Bian, and J\. LiWarpformer: a multi\-scale modeling approach for irregular clinical time series\.InACM SIGKDD Conference on Knowledge Discovery and Data Mining,pp\. 3273–3285\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px9.p1.1),[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Zhanget al\.\(2024\)W\. Zhang, C\. Yin, H\. Liu, X\. Zhou, and H\. XiongIrregular multivariate time series forecasting: a transformable patching graph neural networks approach\.InInternational Conference on Machine Learning,pp\. 60179–60196\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px11.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. - Zhanget al\.\(2022\)X\. Zhang, M\. Zeman, T\. Tsiligkaridis, and M\. ZitnikGraph\-guided network for irregularly sampled multivariate time series\.InInternational Conference on Learning Representations,Cited by:[§2\.1](https://arxiv.org/html/2608.17293#S2.SS1.p1.1)\. - Zhouet al\.\(2026\)Z\. Zhou, Y\. Huang, Y\. Wang, Y\. Wu, J\. Kwok, and Y\. LiangRevitalizing canonical pre\-alignment for irregular multivariate time series forecasting\.InAAAI Conference on Artificial Intelligence,pp\. 29115–29123\.Cited by:[§D\.3](https://arxiv.org/html/2608.17293#A4.SS3.SSS0.Px6.p1.1),[§5\.2](https://arxiv.org/html/2608.17293#S5.SS2.p1.1)\. ## Appendix AProof of Theorem 1 For thess\-th trajectory, denote ps\(t\)=p\(t∣Xs\),ℓs\(t\)=ℓ\(t,Xs\),p\_\{s\}\(t\)=p\(t\\mid X\_\{s\}\),\\qquad\\ell\_\{s\}\(t\)=\\ell\(t,X\_\{s\}\),\(13\)and define rct\(Xs\)\\displaystyle r\_\{\\mathrm\{ct\}\}\(X\_\{s\}\)=1\|𝒯\|∫𝒯ℓs\(t\)𝑑t,\\displaystyle=\\frac\{1\}\{\|\\mathcal\{T\}\|\}\\int\_\{\\mathcal\{T\}\}\\ell\_\{s\}\(t\)\\,dt,\(14\)robs\(Xs\)\\displaystyle r\_\{\\mathrm\{obs\}\}\(X\_\{s\}\)=∫𝒯ℓs\(t\)ps\(t\)𝑑t\.\\displaystyle=\\int\_\{\\mathcal\{T\}\}\\ell\_\{s\}\(t\)p\_\{s\}\(t\)\\,dt\.\(15\)Accordingly, Rct=𝔼X\[rct\(X\)\],Robs=𝔼X\[robs\(X\)\]\.R\_\{\\mathrm\{ct\}\}=\\mathbb\{E\}\_\{X\}\[r\_\{\\mathrm\{ct\}\}\(X\)\],\\qquad R\_\{\\mathrm\{obs\}\}=\\mathbb\{E\}\_\{X\}\[r\_\{\\mathrm\{obs\}\}\(X\)\]\.\(16\) We first introduce the oracle importance\-sampling terms As=1Ls∑i=1Lsℓs\(ts,i\)ps\(ts,i\),Bs=1Ls∑i=1Ls1ps\(ts,i\),A\_\{s\}=\\frac\{1\}\{L\_\{s\}\}\\sum\_\{i=1\}^\{L\_\{s\}\}\\frac\{\\ell\_\{s\}\(t\_\{s,i\}\)\}\{p\_\{s\}\(t\_\{s,i\}\)\},\\qquad B\_\{s\}=\\frac\{1\}\{L\_\{s\}\}\\sum\_\{i=1\}^\{L\_\{s\}\}\\frac\{1\}\{p\_\{s\}\(t\_\{s,i\}\)\},\(17\)and their estimated counterparts A^s=1Ls∑i=1Lsℓs\(ts,i\)p^\(ts,i∣Xs\),B^s=1Ls∑i=1Ls1p^\(ts,i∣Xs\)\.\\widehat\{A\}\_\{s\}=\\frac\{1\}\{L\_\{s\}\}\\sum\_\{i=1\}^\{L\_\{s\}\}\\frac\{\\ell\_\{s\}\(t\_\{s,i\}\)\}\{\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\},\\qquad\\widehat\{B\}\_\{s\}=\\frac\{1\}\{L\_\{s\}\}\\sum\_\{i=1\}^\{L\_\{s\}\}\\frac\{1\}\{\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}\.\(18\) By Assumption 1,ps\(t\)≥ρ\>0p\_\{s\}\(t\)\\geq\\rho\>0andp^\(t∣Xs\)\\widehat\{p\}\(t\\mid X\_\{s\}\)is uniformly consistent on𝒯\\mathcal\{T\}\. Hence, almost surely, for sufficiently largeLsL\_\{s\}, inft∈𝒯p^\(t∣Xs\)≥ρ2,\\inf\_\{t\\in\\mathcal\{T\}\}\\widehat\{p\}\(t\\mid X\_\{s\}\)\\geq\\frac\{\\rho\}\{2\},\(19\)and therefore supt∈𝒯\|1p^\(t∣Xs\)−1ps\(t\)\|\\displaystyle\\sup\_\{t\\in\\mathcal\{T\}\}\\left\|\\frac\{1\}\{\\widehat\{p\}\(t\\mid X\_\{s\}\)\}\-\\frac\{1\}\{p\_\{s\}\(t\)\}\\right\|≤2ρ2supt∈𝒯\|p^\(t∣Xs\)−ps\(t\)\|\\displaystyle\\leq\\frac\{2\}\{\\rho^\{2\}\}\\sup\_\{t\\in\\mathcal\{T\}\}\\left\|\\widehat\{p\}\(t\\mid X\_\{s\}\)\-p\_\{s\}\(t\)\\right\|\(20\)→a\.s\.0\.\\displaystyle\\xrightarrow\{\\mathrm\{a\.s\.\}\}0\. LetM<∞M<\\inftysatisfy0≤ℓ\(t,X\)≤M0\\leq\\ell\(t,X\)\\leq M\. It follows that \|A^s−As\|\\displaystyle\\left\|\\widehat\{A\}\_\{s\}\-A\_\{s\}\\right\|≤Msupt∈𝒯\|1p^\(t∣Xs\)−1ps\(t\)\|→a\.s\.0,\\displaystyle\\leq M\\sup\_\{t\\in\\mathcal\{T\}\}\\left\|\\frac\{1\}\{\\widehat\{p\}\(t\\mid X\_\{s\}\)\}\-\\frac\{1\}\{p\_\{s\}\(t\)\}\\right\|\\xrightarrow\{\\mathrm\{a\.s\.\}\}0,\(21\)\|B^s−Bs\|\\displaystyle\\left\|\\widehat\{B\}\_\{s\}\-B\_\{s\}\\right\|≤supt∈𝒯\|1p^\(t∣Xs\)−1ps\(t\)\|→a\.s\.0\.\\displaystyle\\leq\\sup\_\{t\\in\\mathcal\{T\}\}\\left\|\\frac\{1\}\{\\widehat\{p\}\(t\\mid X\_\{s\}\)\}\-\\frac\{1\}\{p\_\{s\}\(t\)\}\\right\|\\xrightarrow\{\\mathrm\{a\.s\.\}\}0\.\(22\) Conditional onXsX\_\{s\}, the future timestamps are independently and identically distributed according tops\(t\)p\_\{s\}\(t\)\. The strong law of large numbers therefore gives As\\displaystyle A\_\{s\}→a\.s\.𝔼T\|Xs\[ℓs\(T\)ps\(T\)\]=∫𝒯ℓs\(t\)𝑑t,\\displaystyle\\xrightarrow\{\\mathrm\{a\.s\.\}\}\\mathbb\{E\}\_\{T\\mid X\_\{s\}\}\\left\[\\frac\{\\ell\_\{s\}\(T\)\}\{p\_\{s\}\(T\)\}\\right\]=\\int\_\{\\mathcal\{T\}\}\\ell\_\{s\}\(t\)\\,dt,\(23\)Bs\\displaystyle B\_\{s\}→a\.s\.𝔼T\|Xs\[1ps\(T\)\]=\|𝒯\|\.\\displaystyle\\xrightarrow\{\\mathrm\{a\.s\.\}\}\\mathbb\{E\}\_\{T\\mid X\_\{s\}\}\\left\[\\frac\{1\}\{p\_\{s\}\(T\)\}\\right\]=\|\\mathcal\{T\}\|\.\(24\)Combining the above results yields A^s→a\.s\.∫𝒯ℓs\(t\)𝑑t,B^s→a\.s\.\|𝒯\|\.\\widehat\{A\}\_\{s\}\\xrightarrow\{\\mathrm\{a\.s\.\}\}\\int\_\{\\mathcal\{T\}\}\\ell\_\{s\}\(t\)\\,dt,\\qquad\\widehat\{B\}\_\{s\}\\xrightarrow\{\\mathrm\{a\.s\.\}\}\|\\mathcal\{T\}\|\.\(25\) Define the trajectory\-level CSE estimator as r^ct,s=∑i=1Lsℓs\(ts,i\)/p^\(ts,i∣Xs\)∑i=1Ls1/p^\(ts,i∣Xs\)=A^sB^s\.\\widehat\{r\}\_\{\\mathrm\{ct\},s\}=\\frac\{\\sum\_\{i=1\}^\{L\_\{s\}\}\\ell\_\{s\}\(t\_\{s,i\}\)/\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}\{\\sum\_\{i=1\}^\{L\_\{s\}\}1/\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}=\\frac\{\\widehat\{A\}\_\{s\}\}\{\\widehat\{B\}\_\{s\}\}\.\(26\)Since\|𝒯\|\>0\|\\mathcal\{T\}\|\>0, the continuous mapping theorem gives r^ct,s→a\.s\.1\|𝒯\|∫𝒯ℓs\(t\)𝑑t=rct\(Xs\)\.\\widehat\{r\}\_\{\\mathrm\{ct\},s\}\\xrightarrow\{\\mathrm\{a\.s\.\}\}\\frac\{1\}\{\|\\mathcal\{T\}\|\}\\int\_\{\\mathcal\{T\}\}\\ell\_\{s\}\(t\)\\,dt=r\_\{\\mathrm\{ct\}\}\(X\_\{s\}\)\.\(27\) For MSE, the conditional strong law directly gives r^obs,s=1Ls∑i=1Lsℓs\(ts,i\)→a\.s\.𝔼T\|Xs\[ℓs\(T\)\]=robs\(Xs\)\.\\widehat\{r\}\_\{\\mathrm\{obs\},s\}=\\frac\{1\}\{L\_\{s\}\}\\sum\_\{i=1\}^\{L\_\{s\}\}\\ell\_\{s\}\(t\_\{s,i\}\)\\xrightarrow\{\\mathrm\{a\.s\.\}\}\\mathbb\{E\}\_\{T\\mid X\_\{s\}\}\[\\ell\_\{s\}\(T\)\]=r\_\{\\mathrm\{obs\}\}\(X\_\{s\}\)\.\(28\) LetL¯=min1≤s≤SLs\\underline\{L\}=\\min\_\{1\\leq s\\leq S\}L\_\{s\}\. For the joint limit below, Assumption 1 is understood to hold uniformly over the test trajectories\. Consequently, Eqs\. \([27](https://arxiv.org/html/2608.17293#A1.E27)\) and \([28](https://arxiv.org/html/2608.17293#A1.E28)\) imply 1S∑s=1S\|r^ct,s−rct\(Xs\)\|\\displaystyle\\frac\{1\}\{S\}\\sum\_\{s=1\}^\{S\}\\left\|\\widehat\{r\}\_\{\\mathrm\{ct\},s\}\-r\_\{\\mathrm\{ct\}\}\(X\_\{s\}\)\\right\|→a\.s\.0,\\displaystyle\\xrightarrow\{\\mathrm\{a\.s\.\}\}0,\(29\)1S∑s=1S\|r^obs,s−robs\(Xs\)\|\\displaystyle\\frac\{1\}\{S\}\\sum\_\{s=1\}^\{S\}\\left\|\\widehat\{r\}\_\{\\mathrm\{obs\},s\}\-r\_\{\\mathrm\{obs\}\}\(X\_\{s\}\)\\right\|→a\.s\.0\\displaystyle\\xrightarrow\{\\mathrm\{a\.s\.\}\}0\(30\)asL¯→∞\\underline\{L\}\\rightarrow\\infty\. Since the test trajectories are mutually independent and the trajectory\-level risks are bounded, another application of the strong law yields 1S∑s=1Srct\(Xs\)→a\.s\.Rct,1S∑s=1Srobs\(Xs\)→a\.s\.Robs\.\\frac\{1\}\{S\}\\sum\_\{s=1\}^\{S\}r\_\{\\mathrm\{ct\}\}\(X\_\{s\}\)\\xrightarrow\{\\mathrm\{a\.s\.\}\}R\_\{\\mathrm\{ct\}\},\\qquad\\frac\{1\}\{S\}\\sum\_\{s=1\}^\{S\}r\_\{\\mathrm\{obs\}\}\(X\_\{s\}\)\\xrightarrow\{\\mathrm\{a\.s\.\}\}R\_\{\\mathrm\{obs\}\}\.\(31\) Table 3:Complete MSE and CSE results on CESNET, FNSPID, GDELT, and HumanActivity\. Values are mean±\\pmstandard deviation over three random seeds; standard deviations are rounded to three decimal places\.ModelCESNET×10−1\\times 10^\{\-1\}FNSPID×10−1\\times 10^\{\-1\}GDELT×100\\times 10^\{0\}HumanActivity×10−2\\times 10^\{\-2\}MSECSEMSECSEMSECSEMSECSEAPN±0\.007\(5\)8\.76\\\!\\pm\\\!0\.007^\{\(5\)\}±0\.008\(5\)8\.58\\\!\\pm\\\!0\.008^\{\(5\)\}2\.38¯±0\.143\(2\)\\underline\{2\.38\}\\\!\\pm\\\!0\.143^\{\(2\)\}2\.38¯±0\.144\(2\)\\underline\{2\.38\}\\\!\\pm\\\!0\.144^\{\(2\)\}±0\.001\(1\)\\mathbf\{1\.02\}\\\!\\pm\\\!0\.001^\{\(1\)\}±0\.001\(1\)\\mathbf\{0\.99\}\\\!\\pm\\\!0\.001^\{\(1\)\}±0\.035\(6\)5\.68\\\!\\pm\\\!0\.035^\{\(6\)\}±0\.039\(6\)5\.65\\\!\\pm\\\!0\.039^\{\(6\)\}ASTGI±0\.137\(1\)\\mathbf\{8\.47\}\\\!\\pm\\\!0\.137^\{\(1\)\}±0\.122\(1\)\\mathbf\{8\.26\}\\\!\\pm\\\!0\.122^\{\(1\)\}±0\.213\(6\)3\.28\\\!\\pm\\\!0\.213^\{\(6\)\}±0\.211\(6\)3\.25\\\!\\pm\\\!0\.211^\{\(6\)\}±0\.003\(4\)1\.10\\\!\\pm\\\!0\.003^\{\(4\)\}±0\.003\(4\)1\.04\\\!\\pm\\\!0\.003^\{\(4\)\}±0\.167\(3\)5\.46\\\!\\pm\\\!0\.167^\{\(3\)\}±0\.167\(3\)5\.41\\\!\\pm\\\!0\.167^\{\(3\)\}GRU\-D±0\.464\(10\)10\.22\\\!\\pm\\\!0\.464^\{\(10\)\}±0\.466\(10\)9\.91\\\!\\pm\\\!0\.466^\{\(10\)\}±0\.800\(8\)5\.24\\\!\\pm\\\!0\.800^\{\(8\)\}±0\.791\(8\)5\.20\\\!\\pm\\\!0\.791^\{\(8\)\}±0\.003\(10\)1\.22\\\!\\pm\\\!0\.003^\{\(10\)\}±0\.003\(10\)1\.15\\\!\\pm\\\!0\.003^\{\(10\)\}±1\.497\(9\)8\.56\\\!\\pm\\\!1\.497^\{\(9\)\}±1\.515\(9\)8\.56\\\!\\pm\\\!1\.515^\{\(9\)\}GraFITi8\.50¯±0\.113\(2\)\\underline\{8\.50\}\\\!\\pm\\\!0\.113^\{\(2\)\}8\.28¯±0\.102\(2\)\\underline\{8\.28\}\\\!\\pm\\\!0\.102^\{\(2\)\}±0\.755\(4\)3\.21\\\!\\pm\\\!0\.755^\{\(4\)\}±0\.760\(4\)3\.22\\\!\\pm\\\!0\.760^\{\(4\)\}±0\.002\(3\)1\.09\\\!\\pm\\\!0\.002^\{\(3\)\}1\.01¯±0\.002\(2\)\\underline\{1\.01\}\\\!\\pm\\\!0\.002^\{\(2\)\}5\.44¯±0\.038\(2\)\\underline\{5\.44\}\\\!\\pm\\\!0\.038^\{\(2\)\}5\.40¯±0\.034\(2\)\\underline\{5\.40\}\\\!\\pm\\\!0\.034^\{\(2\)\}HyperIMTS±0\.073\(7\)8\.90\\\!\\pm\\\!0\.073^\{\(7\)\}±0\.060\(7\)8\.65\\\!\\pm\\\!0\.060^\{\(7\)\}±0\.593\(3\)2\.72\\\!\\pm\\\!0\.593^\{\(3\)\}±0\.592\(3\)2\.71\\\!\\pm\\\!0\.592^\{\(3\)\}±0\.002\(8\)1\.18\\\!\\pm\\\!0\.002^\{\(8\)\}±0\.002\(8\)1\.09\\\!\\pm\\\!0\.002^\{\(8\)\}±0\.037\(1\)\\mathbf\{5\.42\}\\\!\\pm\\\!0\.037^\{\(1\)\}±0\.039\(1\)\\mathbf\{5\.38\}\\\!\\pm\\\!0\.039^\{\(1\)\}KAFNet±0\.012\(4\)8\.73\\\!\\pm\\\!0\.012^\{\(4\)\}±0\.003\(4\)8\.54\\\!\\pm\\\!0\.003^\{\(4\)\}±0\.047\(1\)\\mathbf\{2\.23\}\\\!\\pm\\\!0\.047^\{\(1\)\}±0\.043\(1\)\\mathbf\{2\.22\}\\\!\\pm\\\!0\.043^\{\(1\)\}1\.08¯±0\.005\(2\)\\underline\{1\.08\}\\\!\\pm\\\!0\.005^\{\(2\)\}±0\.005\(3\)1\.02\\\!\\pm\\\!0\.005^\{\(3\)\}±0\.021\(4\)5\.62\\\!\\pm\\\!0\.021^\{\(4\)\}±0\.025\(4\)5\.58\\\!\\pm\\\!0\.025^\{\(4\)\}NeuralFlow±0\.103\(8\)9\.98\\\!\\pm\\\!0\.103^\{\(8\)\}±0\.118\(8\)9\.69\\\!\\pm\\\!0\.118^\{\(8\)\}±0\.138\(10\)7\.33\\\!\\pm\\\!0\.138^\{\(10\)\}±0\.140\(10\)7\.29\\\!\\pm\\\!0\.140^\{\(10\)\}±0\.005\(9\)1\.18\\\!\\pm\\\!0\.005^\{\(9\)\}±0\.005\(9\)1\.09\\\!\\pm\\\!0\.005^\{\(9\)\}±2\.512\(11\)17\.53\\\!\\pm\\\!2\.512^\{\(11\)\}±2\.523\(11\)17\.51\\\!\\pm\\\!2\.523^\{\(11\)\}SeFT±0\.183\(9\)10\.11\\\!\\pm\\\!0\.183^\{\(9\)\}±0\.177\(9\)9\.79\\\!\\pm\\\!0\.177^\{\(9\)\}±0\.958\(11\)8\.70\\\!\\pm\\\!0\.958^\{\(11\)\}±0\.957\(11\)8\.66\\\!\\pm\\\!0\.957^\{\(11\)\}±0\.003\(6\)1\.13\\\!\\pm\\\!0\.003^\{\(6\)\}±0\.003\(5\)1\.05\\\!\\pm\\\!0\.003^\{\(5\)\}±0\.422\(10\)9\.38\\\!\\pm\\\!0\.422^\{\(10\)\}±0\.406\(10\)9\.36\\\!\\pm\\\!0\.406^\{\(10\)\}Warpformer±0\.067\(3\)8\.58\\\!\\pm\\\!0\.067^\{\(3\)\}±0\.058\(3\)8\.37\\\!\\pm\\\!0\.058^\{\(3\)\}±0\.216\(7\)3\.66\\\!\\pm\\\!0\.216^\{\(7\)\}±0\.220\(7\)3\.63\\\!\\pm\\\!0\.220^\{\(7\)\}±0\.016\(11\)1\.30\\\!\\pm\\\!0\.016^\{\(11\)\}±0\.016\(11\)1\.20\\\!\\pm\\\!0\.016^\{\(11\)\}±0\.143\(5\)5\.65\\\!\\pm\\\!0\.143^\{\(5\)\}±0\.141\(5\)5\.61\\\!\\pm\\\!0\.141^\{\(5\)\}mTAN±0\.153\(11\)10\.47\\\!\\pm\\\!0\.153^\{\(11\)\}±0\.106\(11\)10\.14\\\!\\pm\\\!0\.106^\{\(11\)\}±0\.743\(9\)6\.13\\\!\\pm\\\!0\.743^\{\(9\)\}±0\.738\(9\)6\.09\\\!\\pm\\\!0\.738^\{\(9\)\}±0\.003\(5\)1\.12\\\!\\pm\\\!0\.003^\{\(5\)\}±0\.003\(6\)1\.05\\\!\\pm\\\!0\.003^\{\(6\)\}±0\.108\(8\)7\.33\\\!\\pm\\\!0\.108^\{\(8\)\}±0\.107\(8\)7\.30\\\!\\pm\\\!0\.107^\{\(8\)\}tPatchGNN±0\.140\(6\)8\.86\\\!\\pm\\\!0\.140^\{\(6\)\}±0\.114\(6\)8\.61\\\!\\pm\\\!0\.114^\{\(6\)\}±0\.269\(5\)3\.26\\\!\\pm\\\!0\.269^\{\(5\)\}±0\.269\(5\)3\.24\\\!\\pm\\\!0\.269^\{\(5\)\}±0\.006\(7\)1\.15\\\!\\pm\\\!0\.006^\{\(7\)\}±0\.006\(7\)1\.08\\\!\\pm\\\!0\.006^\{\(7\)\}±0\.121\(7\)5\.80\\\!\\pm\\\!0\.121^\{\(7\)\}±0\.132\(7\)5\.76\\\!\\pm\\\!0\.132^\{\(7\)\} Therefore, asS,L¯→∞S,\\underline\{L\}\\rightarrow\\infty, CSE→a\.s\.Rct,MSE→a\.s\.Robs\.\\mathrm\{CSE\}\\xrightarrow\{\\mathrm\{a\.s\.\}\}R\_\{\\mathrm\{ct\}\},\\qquad\\mathrm\{MSE\}\\xrightarrow\{\\mathrm\{a\.s\.\}\}R\_\{\\mathrm\{obs\}\}\.\(32\)It follows that limS,L¯→∞\|CSE−Rct\|\\displaystyle\\lim\_\{S,\\underline\{L\}\\rightarrow\\infty\}\\left\|\\mathrm\{CSE\}\-R\_\{\\mathrm\{ct\}\}\\right\|=0,\\displaystyle=0,\(33\)limS,L¯→∞\|MSE−Rct\|\\displaystyle\\lim\_\{S,\\underline\{L\}\\rightarrow\\infty\}\\left\|\\mathrm\{MSE\}\-R\_\{\\mathrm\{ct\}\}\\right\|=\|Robs−Rct\|\\displaystyle=\\left\|R\_\{\\mathrm\{obs\}\}\-R\_\{\\mathrm\{ct\}\}\\right\|\(34\)almost surely\. Hence, limS,L¯→∞\|CSE−Rct\|≤limS,L¯→∞\|MSE−Rct\|\.\\lim\_\{S,\\underline\{L\}\\rightarrow\\infty\}\\left\|\\mathrm\{CSE\}\-R\_\{\\mathrm\{ct\}\}\\right\|\\leq\\lim\_\{S,\\underline\{L\}\\rightarrow\\infty\}\\left\|\\mathrm\{MSE\}\-R\_\{\\mathrm\{ct\}\}\\right\|\.\(35\) Whenp\(t∣X\)=1/\|𝒯\|p\(t\\mid X\)=1/\|\\mathcal\{T\}\|almost everywhere, we haveRobs=RctR\_\{\\mathrm\{obs\}\}=R\_\{\\mathrm\{ct\}\}, and both asymptotic estimation errors are zero\. More generally, equality holds wheneverRobs=RctR\_\{\\mathrm\{obs\}\}=R\_\{\\mathrm\{ct\}\}, whereas the inequality is strict whenRobs≠RctR\_\{\\mathrm\{obs\}\}\\neq R\_\{\\mathrm\{ct\}\}\. The self\-normalized estimator may be biased at a finite sample size; the result above concerns its consistency and asymptotic estimation error\. ## Appendix BDerivation of the Evaluation Discrepancy Recall that pT\(t\)=𝔼X\[p\(t∣X\)\],ℓ¯\(t\)=𝔼X\[ℓ\(t,X\)\]\.p\_\{T\}\(t\)=\\mathbb\{E\}\_\{X\}\[p\(t\\mid X\)\],\\qquad\\overline\{\\ell\}\(t\)=\\mathbb\{E\}\_\{X\}\[\\ell\(t,X\)\]\.\(36\) For the sampling\-dependence gap, Gsamp\\displaystyle G\_\{\\mathrm\{samp\}\}=Robs−Rglobal\\displaystyle=R\_\{\\mathrm\{obs\}\}\-R\_\{\\mathrm\{global\}\}=𝔼X\[∫𝒯ℓ\(t,X\)p\(t∣X\)𝑑t\]−𝔼X\[∫𝒯ℓ\(t,X\)pT\(t\)𝑑t\]\\displaystyle=\\mathbb\{E\}\_\{X\}\\left\[\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)p\(t\\mid X\)\\,dt\\right\]\-\\mathbb\{E\}\_\{X\}\\left\[\\int\_\{\\mathcal\{T\}\}\\ell\(t,X\)p\_\{T\}\(t\)\\,dt\\right\]=∫𝒯\{𝔼X\[ℓ\(t,X\)p\(t∣X\)\]−𝔼X\[ℓ\(t,X\)\]𝔼X\[p\(t∣X\)\]\}𝑑t\\displaystyle=\\int\_\{\\mathcal\{T\}\}\\left\\\{\\mathbb\{E\}\_\{X\}\[\\ell\(t,X\)p\(t\\mid X\)\]\-\\mathbb\{E\}\_\{X\}\[\\ell\(t,X\)\]\\mathbb\{E\}\_\{X\}\[p\(t\\mid X\)\]\\right\\\}dt=∫𝒯CovX\(ℓ\(t,X\),p\(t∣X\)\)𝑑t\.\\displaystyle=\\int\_\{\\mathcal\{T\}\}\\operatorname\{Cov\}\_\{X\}\\left\(\\ell\(t,X\),p\(t\\mid X\)\\right\)dt\.\(37\) For the temporal\-distribution gap, letU∼Unif\(𝒯\)U\\sim\\operatorname\{Unif\}\(\\mathcal\{T\}\)\. Since𝔼U\[\|𝒯\|pT\(U\)\]=1\\mathbb\{E\}\_\{U\}\[\|\\mathcal\{T\}\|p\_\{T\}\(U\)\]=1, we have Gtime\\displaystyle G\_\{\\mathrm\{time\}\}=Rglobal−Rct\\displaystyle=R\_\{\\mathrm\{global\}\}\-R\_\{\\mathrm\{ct\}\}=∫𝒯ℓ¯\(t\)pT\(t\)𝑑t−1\|𝒯\|∫𝒯ℓ¯\(t\)𝑑t\\displaystyle=\\int\_\{\\mathcal\{T\}\}\\overline\{\\ell\}\(t\)p\_\{T\}\(t\)\\,dt\-\\frac\{1\}\{\|\\mathcal\{T\}\|\}\\int\_\{\\mathcal\{T\}\}\\overline\{\\ell\}\(t\)\\,dt=𝔼U\[ℓ¯\(U\)\|𝒯\|pT\(U\)\]−𝔼U\[ℓ¯\(U\)\]𝔼U\[\|𝒯\|pT\(U\)\]\\displaystyle=\\mathbb\{E\}\_\{U\}\\left\[\\overline\{\\ell\}\(U\)\|\\mathcal\{T\}\|p\_\{T\}\(U\)\\right\]\-\\mathbb\{E\}\_\{U\}\[\\overline\{\\ell\}\(U\)\]\\mathbb\{E\}\_\{U\}\[\|\\mathcal\{T\}\|p\_\{T\}\(U\)\]=CovU∼Unif\(𝒯\)\(ℓ¯\(U\),\|𝒯\|pT\(U\)\)\.\\displaystyle=\\operatorname\{Cov\}\_\{U\\sim\\operatorname\{Unif\}\(\\mathcal\{T\}\)\}\\left\(\\overline\{\\ell\}\(U\),\|\\mathcal\{T\}\|p\_\{T\}\(U\)\\right\)\.\(38\) Therefore, Robs−Rct=Gsamp\+Gtime\.R\_\{\\mathrm\{obs\}\}\-R\_\{\\mathrm\{ct\}\}=G\_\{\\mathrm\{samp\}\}\+G\_\{\\mathrm\{time\}\}\.\(39\)Here,GsampG\_\{\\mathrm\{samp\}\}captures the effect of sample\-dependent sampling, whereasGtimeG\_\{\\mathrm\{time\}\}captures the effect of population\-level temporal non\-uniformity\. ## Appendix CGlobal\-Time Squared Error The marginal timestamp density is estimated by averaging the trajectory\-specific conditional densities: p^T\(t\)=1S∑r=1Sp^\(t∣Xr\)\.\\widehat\{p\}\_\{T\}\(t\)=\\frac\{1\}\{S\}\\sum\_\{r=1\}^\{S\}\\widehat\{p\}\(t\\mid X\_\{r\}\)\.\(40\) Usingp^\(t∣Xs\)\\widehat\{p\}\(t\\mid X\_\{s\}\)as the proposal density andp^T\(t\)\\widehat\{p\}\_\{T\}\(t\)as the target density, we define the Global\-Time Squared Error as GSE=1S∑s=1S∑i=1Lsℓ\(ts,i,Xs\)p^T\(ts,i\)p^\(ts,i∣Xs\)∑i=1Lsp^T\(ts,i\)p^\(ts,i∣Xs\)\.\\mathrm\{GSE\}=\\frac\{1\}\{S\}\\sum\_\{s=1\}^\{S\}\\frac\{\\displaystyle\\sum\_\{i=1\}^\{L\_\{s\}\}\\ell\(t\_\{s,i\},X\_\{s\}\)\\frac\{\\widehat\{p\}\_\{T\}\(t\_\{s,i\}\)\}\{\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}\}\{\\displaystyle\\sum\_\{i=1\}^\{L\_\{s\}\}\\frac\{\\widehat\{p\}\_\{T\}\(t\_\{s,i\}\)\}\{\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}\}\.\(41\) GSE evaluates each trajectory under the dataset\-level marginal timestamp distribution, thereby removing sample\-specific sampling effects while retaining population\-level temporal non\-uniformity\. It serves as the empirical counterpart ofRglobalR\_\{\\mathrm\{global\}\}and an intermediate reference between MSE and CSE\. Table 4:Complete MSE and CSE results on MIMIC\-III, RepoHealth, StudentLife, and USHCN\. Values are mean±\\pmstandard deviation over three random seeds; standard deviations are rounded to three decimal places\.ModelMIMIC\-III×10−1\\times 10^\{\-1\}RepoHealth×10−1\\times 10^\{\-1\}StudentLife×10−1\\times 10^\{\-1\}USHCN×10−1\\times 10^\{\-1\}MSECSEMSECSEMSECSEMSECSEAPN±0\.038\(6\)6\.66\\\!\\pm\\\!0\.038^\{\(6\)\}±0\.038\(6\)6\.72\\\!\\pm\\\!0\.038^\{\(6\)\}3\.36¯±0\.069\(2\)\\underline\{3\.36\}\\\!\\pm\\\!0\.069^\{\(2\)\}±0\.080\(1\)\\mathbf\{3\.57\}\\\!\\pm\\\!0\.080^\{\(1\)\}6\.61¯±0\.009\(2\)\\underline\{6\.61\}\\\!\\pm\\\!0\.009^\{\(2\)\}±0\.006\(3\)6\.68\\\!\\pm\\\!0\.006^\{\(3\)\}±0\.554\(4\)6\.04\\\!\\pm\\\!0\.554^\{\(4\)\}±0\.686\(5\)6\.71\\\!\\pm\\\!0\.686^\{\(5\)\}ASTGI±0\.000\(11\)10\.50\\\!\\pm\\\!0\.000^\{\(11\)\}±0\.000\(11\)10\.62\\\!\\pm\\\!0\.000^\{\(11\)\}±2\.310\(7\)6\.27\\\!\\pm\\\!2\.310^\{\(7\)\}±2\.378\(7\)6\.53\\\!\\pm\\\!2\.378^\{\(7\)\}±0\.036\(3\)6\.65\\\!\\pm\\\!0\.036^\{\(3\)\}6\.65¯±0\.038\(2\)\\underline\{6\.65\}\\\!\\pm\\\!0\.038^\{\(2\)\}±0\.169\(3\)5\.14\\\!\\pm\\\!0\.169^\{\(3\)\}±0\.179\(3\)5\.66\\\!\\pm\\\!0\.179^\{\(3\)\}GRU\-D±0\.043\(7\)6\.67\\\!\\pm\\\!0\.043^\{\(7\)\}±0\.046\(7\)6\.75\\\!\\pm\\\!0\.046^\{\(7\)\}±0\.695\(11\)11\.68\\\!\\pm\\\!0\.695^\{\(11\)\}±0\.672\(11\)11\.95\\\!\\pm\\\!0\.672^\{\(11\)\}±0\.045\(8\)7\.21\\\!\\pm\\\!0\.045^\{\(8\)\}±0\.045\(8\)7\.23\\\!\\pm\\\!0\.045^\{\(8\)\}±0\.690\(11\)7\.78\\\!\\pm\\\!0\.690^\{\(11\)\}±0\.756\(11\)8\.59\\\!\\pm\\\!0\.756^\{\(11\)\}GraFITi±0\.264\(1\)\\mathbf\{5\.89\}\\\!\\pm\\\!0\.264^\{\(1\)\}6\.02¯±0\.278\(2\)\\underline\{6\.02\}\\\!\\pm\\\!0\.278^\{\(2\)\}±0\.341\(1\)\\mathbf\{3\.32\}\\\!\\pm\\\!0\.341^\{\(1\)\}3\.61¯±0\.342\(2\)\\underline\{3\.61\}\\\!\\pm\\\!0\.342^\{\(2\)\}±0\.164\(6\)6\.72\\\!\\pm\\\!0\.164^\{\(6\)\}±0\.162\(4\)6\.70\\\!\\pm\\\!0\.162^\{\(4\)\}±0\.252\(1\)\\mathbf\{4\.50\}\\\!\\pm\\\!0\.252^\{\(1\)\}±0\.299\(1\)\\mathbf\{4\.89\}\\\!\\pm\\\!0\.299^\{\(1\)\}HyperIMTS5\.94¯±0\.068\(2\)\\underline\{5\.94\}\\\!\\pm\\\!0\.068^\{\(2\)\}±0\.068\(1\)\\mathbf\{5\.92\}\\\!\\pm\\\!0\.068^\{\(1\)\}±0\.437\(3\)3\.72\\\!\\pm\\\!0\.437^\{\(3\)\}±0\.444\(3\)3\.97\\\!\\pm\\\!0\.444^\{\(3\)\}±0\.067\(1\)\\mathbf\{6\.54\}\\\!\\pm\\\!0\.067^\{\(1\)\}±0\.062\(1\)\\mathbf\{6\.56\}\\\!\\pm\\\!0\.062^\{\(1\)\}±1\.837\(8\)6\.67\\\!\\pm\\\!1\.837^\{\(8\)\}±2\.073\(8\)7\.30\\\!\\pm\\\!2\.073^\{\(8\)\}KAFNet±0\.021\(3\)6\.41\\\!\\pm\\\!0\.021^\{\(3\)\}±0\.022\(3\)6\.47\\\!\\pm\\\!0\.022^\{\(3\)\}±3\.034\(6\)5\.72\\\!\\pm\\\!3\.034^\{\(6\)\}±3\.061\(6\)5\.98\\\!\\pm\\\!3\.061^\{\(6\)\}±0\.023\(4\)6\.66\\\!\\pm\\\!0\.023^\{\(4\)\}±0\.024\(5\)6\.72\\\!\\pm\\\!0\.024^\{\(5\)\}±0\.418\(9\)7\.14\\\!\\pm\\\!0\.418^\{\(9\)\}±0\.406\(9\)7\.82\\\!\\pm\\\!0\.406^\{\(9\)\}NeuralFlow±0\.042\(8\)7\.05\\\!\\pm\\\!0\.042^\{\(8\)\}±0\.044\(9\)7\.19\\\!\\pm\\\!0\.044^\{\(9\)\}±0\.283\(10\)10\.13\\\!\\pm\\\!0\.283^\{\(10\)\}±0\.320\(10\)10\.44\\\!\\pm\\\!0\.320^\{\(10\)\}±0\.218\(10\)7\.83\\\!\\pm\\\!0\.218^\{\(10\)\}±0\.212\(10\)7\.86\\\!\\pm\\\!0\.212^\{\(10\)\}±0\.720\(5\)6\.07\\\!\\pm\\\!0\.720^\{\(5\)\}±0\.764\(6\)6\.74\\\!\\pm\\\!0\.764^\{\(6\)\}SeFT±0\.060\(9\)7\.10\\\!\\pm\\\!0\.060^\{\(9\)\}±0\.060\(8\)7\.15\\\!\\pm\\\!0\.060^\{\(8\)\}±0\.454\(8\)9\.13\\\!\\pm\\\!0\.454^\{\(8\)\}±0\.463\(8\)9\.44\\\!\\pm\\\!0\.463^\{\(8\)\}±1\.706\(11\)8\.94\\\!\\pm\\\!1\.706^\{\(11\)\}±1\.700\(11\)8\.95\\\!\\pm\\\!1\.700^\{\(11\)\}±0\.137\(10\)7\.64\\\!\\pm\\\!0\.137^\{\(10\)\}±0\.170\(10\)8\.41\\\!\\pm\\\!0\.170^\{\(10\)\}Warpformer±0\.041\(4\)6\.42\\\!\\pm\\\!0\.041^\{\(4\)\}±0\.045\(5\)6\.50\\\!\\pm\\\!0\.045^\{\(5\)\}±0\.555\(5\)5\.04\\\!\\pm\\\!0\.555^\{\(5\)\}±0\.598\(5\)5\.33\\\!\\pm\\\!0\.598^\{\(5\)\}±0\.065\(7\)6\.78\\\!\\pm\\\!0\.065^\{\(7\)\}±0\.066\(7\)6\.80\\\!\\pm\\\!0\.066^\{\(7\)\}±0\.168\(6\)6\.13\\\!\\pm\\\!0\.168^\{\(6\)\}±0\.195\(4\)6\.67\\\!\\pm\\\!0\.195^\{\(4\)\}mTAN±0\.034\(10\)7\.47\\\!\\pm\\\!0\.034^\{\(10\)\}±0\.032\(10\)7\.54\\\!\\pm\\\!0\.032^\{\(10\)\}±0\.438\(9\)10\.09\\\!\\pm\\\!0\.438^\{\(9\)\}±0\.443\(9\)10\.39\\\!\\pm\\\!0\.443^\{\(9\)\}±0\.069\(9\)7\.32\\\!\\pm\\\!0\.069^\{\(9\)\}±0\.067\(9\)7\.34\\\!\\pm\\\!0\.067^\{\(9\)\}4\.84¯±0\.174\(2\)\\underline\{4\.84\}\\\!\\pm\\\!0\.174^\{\(2\)\}5\.23¯±0\.232\(2\)\\underline\{5\.23\}\\\!\\pm\\\!0\.232^\{\(2\)\}tPatchGNN±0\.029\(5\)6\.44\\\!\\pm\\\!0\.029^\{\(5\)\}±0\.021\(4\)6\.48\\\!\\pm\\\!0\.021^\{\(4\)\}±0\.322\(4\)4\.55\\\!\\pm\\\!0\.322^\{\(4\)\}±0\.335\(4\)4\.82\\\!\\pm\\\!0\.335^\{\(4\)\}±0\.059\(5\)6\.68\\\!\\pm\\\!0\.059^\{\(5\)\}±0\.060\(6\)6\.73\\\!\\pm\\\!0\.060^\{\(6\)\}±1\.306\(7\)6\.36\\\!\\pm\\\!1\.306^\{\(7\)\}±1\.384\(7\)7\.05\\\!\\pm\\\!1\.384^\{\(7\)\} ## Appendix DBenchmark Details ### D\.1Synthetic and Semi\-Synthetic Data #### Common setup\. The controlled benchmark contains two fully synthetic datasets, Synthetic\-Regime and Synthetic\-Multiscale, and two semi\-synthetic datasets constructed from ETTm1 and Weather\. Each dataset contains 512 training, 128 validation, and 128 test trajectories\. For each trajectory, 16 historical observations are provided as input\. Training and validation use 30 future target points, whereas each test realization contains 128 future query timestamps\. For fully synthetic data, the historical and future intervals are\[0,0\.5\]\[0,0\.5\]and\(0\.5,1\]\(0\.5,1\], respectively\. Gaussian noise with standard deviation0\.0020\.002is added only to the historical observations\. #### Synthetic\-Regime\. Each trajectory is controlled byz1,z2∼i\.i\.d\.𝒩\(0,1\)z\_\{1\},z\_\{2\}\\overset\{\\mathrm\{i\.i\.d\.\}\}\{\\sim\}\\mathcal\{N\}\(0,1\)\. We first define r\(t\)\\displaystyle r\(t\)=clip\(t−0\.580\.68−0\.58,0,1\),\\displaystyle=\\operatorname\{clip\}\\left\(\\frac\{t\-0\.58\}\{0\.68\-0\.58\},0,1\\right\),\(42\)w\(t\)\\displaystyle w\(t\)=r\(t\)2\{3−2r\(t\)\}\.\\displaystyle=r\(t\)^\{2\}\\\{3\-2r\(t\)\\\}\.The smooth and periodic components are b1\(t\)\\displaystyle b\_\{1\}\(t\)=0\.10z1\+0\.015sin\(2πt\),\\displaystyle=0\.10z\_\{1\}\+0\.015\\sin\(2\\pi t\),\(43\)b2\(t\)\\displaystyle b\_\{2\}\(t\)=0\.10z2\+0\.012cos\(2πt\),\\displaystyle=0\.10z\_\{2\}\+0\.012\\cos\(2\\pi t\),b3\(t\)\\displaystyle b\_\{3\}\(t\)=0\.07\(z1−z2\)\+0\.010sin\(4πt\),\\displaystyle=0\.07\(z\_\{1\}\-z\_\{2\}\)\+0\.010\\sin\(4\\pi t\),p1\(t\)\\displaystyle p\_\{1\}\(t\)=\(0\.48\+0\.04z2\)sin\(12π\(t−0\.64\)\),\\displaystyle=\(0\.48\+0\.04z\_\{2\}\)\\sin\\\!\\left\(12\\pi\(t\-0\.64\)\\right\),p2\(t\)\\displaystyle p\_\{2\}\(t\)=\(0\.44\+0\.04z1\)cos\(10π\(t−0\.64\)\),\\displaystyle=\(0\.44\+0\.04z\_\{1\}\)\\cos\\\!\\left\(10\\pi\(t\-0\.64\)\\right\),p3\(t\)\\displaystyle p\_\{3\}\(t\)=\{0\.40\+0\.03\(z1\+z2\)\}sin\(8π\(t−0\.64\)\)\.\\displaystyle=\\\{0\.40\+0\.03\(z\_\{1\}\+z\_\{2\}\)\\\}\\sin\\\!\\left\(8\\pi\(t\-0\.64\)\\right\)\.The final three\-dimensional trajectory is yj\(t\)=bj\(t\)\+w\(t\)pj\(t\),j∈\{1,2,3\}\.y\_\{j\}\(t\)=b\_\{j\}\(t\)\+w\(t\)p\_\{j\}\(t\),\\qquad j\\in\\\{1,2,3\\\}\.\(44\)The transition functionw\(t\)w\(t\)continuously changes the process from a low\-amplitude smooth regime to a high\-frequency periodic regime, producing different levels of forecasting difficulty across the future interval\. #### Synthetic\-Multiscale\. Forz1,z2,z3∼i\.i\.d\.𝒩\(0,1\)z\_\{1\},z\_\{2\},z\_\{3\}\\overset\{\\mathrm\{i\.i\.d\.\}\}\{\\sim\}\\mathcal\{N\}\(0,1\), we define g0\(t\)\\displaystyle g\_\{0\}\(t\)=0\.25z1\+0\.18t\+0\.32sin\(2π⋅1\.25t\+0\.20z2\),\\displaystyle=0\.25z\_\{1\}\+0\.18t\+0\.32\\sin\(2\\pi\\\!\\cdot\\\!1\.25t\+0\.20z\_\{2\}\),\(45\)gh\(t\)\\displaystyle g\_\{h\}\(t\)=0\.14\(1\+0\.08z1\)sin\(2π⋅8t\+0\.25z3\),\\displaystyle=0\.14\(1\+0\.08z\_\{1\}\)\\sin\(2\\pi\\\!\\cdot\\\!8t\+0\.25z\_\{3\}\),μ\\displaystyle\\mu=0\.72\+0\.025tanh\(z3\),\\displaystyle=0\.72\+0\.025\\tanh\(z\_\{3\}\),gb\(t\)\\displaystyle g\_\{b\}\(t\)=0\.30\(1\+0\.06z2\)exp\{−\(t−μ\)22\(0\.055\)2\}\.\\displaystyle=0\.30\(1\+0\.06z\_\{2\}\)\\exp\\\!\\left\\\{\-\\frac\{\(t\-\\mu\)^\{2\}\}\{2\(0\.055\)^\{2\}\}\\right\\\}\.The output channels are y1\(t\)\\displaystyle y\_\{1\}\(t\)=g0\(t\)\+gh\(t\)\+gb\(t\),\\displaystyle=g\_\{0\}\(t\)\+g\_\{h\}\(t\)\+g\_\{b\}\(t\),\(46\)y2\(t\)\\displaystyle y\_\{2\}\(t\)=0\.75g0\(t\)−0\.80gh\(t\)\+0\.65gb\(t\)\\displaystyle=0\.75g\_\{0\}\(t\)\-0\.80g\_\{h\}\(t\)\+0\.65g\_\{b\}\(t\)\+0\.08cos\(5πt\),\\displaystyle\+0\.08\\cos\(5\\pi t\),y3\(t\)\\displaystyle y\_\{3\}\(t\)=−0\.45g0\(t\)\+0\.55gh\(t\)−0\.70gb\(t\)\\displaystyle=\-0\.45g\_\{0\}\(t\)\+0\.55g\_\{h\}\(t\)\-0\.70g\_\{b\}\(t\)\+0\.12t\+0\.10sin\(1\.5πt\+0\.30z1\)\.\\displaystyle\+0\.12t\+0\.10\\sin\(1\.5\\pi t\+0\.30z\_\{1\}\)\.This construction combines trend, low\- and high\-frequency periodicity, and a localized transient component\. #### Semi\-synthetic datasets\. For ETTm1 and Weather, the original regularly sampled series are chronologically divided into training, validation, and test segments with a ratio of60%/20%/20%60\\%/20\\%/20\\%\. Standardization statistics are fitted using the training segment\. Each sample contains 96 historical grid points and 512 future grid points\. We retain 16 historical points as input and sample 30 future points for training and validation\. At test time, 128 future points are selected from the complete 512\-point future grid, which is retained to compute the reference continuous\-time risk\. For all four datasets, test timestamps are sampled from pα\(u\)=αBeta\(u,10,60\)\+\(1−α\)Uniform\(0,1\),p\_\{\\alpha\}\(u\)=\\alpha\\,\\operatorname\{Beta\}\(u;10,60\)\+\(1\-\\alpha\)\\,\\operatorname\{Uniform\}\(0,1\),\(47\)whereα∈\{0,0\.3,0\.5,0\.9,0\.99\}\\alpha\\in\\\{0,0\.3,0\.5,0\.9,0\.99\\\}controls the degree of temporal non\-uniformity\. For eachα\\alpha, the trained model, historical observations, and underlying future trajectory are fixed, while only the test query timestamps are resampled\. Each setting is evaluated using 20 timestamp resamples shared across all models\. Table 5:Complete MAE and CAE results on CESNET, FNSPID, GDELT, and HumanActivity\. Values are mean±\\pmstandard deviation over three random seeds; standard deviations are rounded to three decimal places\.ModelCESNET×10−1\\times 10^\{\-1\}FNSPID×10−1\\times 10^\{\-1\}GDELT×10−1\\times 10^\{\-1\}HumanActivity×10−1\\times 10^\{\-1\}MAECAEMAECAEMAECAEMAECAEAPN±0\.003\(5\)6\.69\\\!\\pm\\\!0\.003^\{\(5\)\}±0\.003\(5\)6\.62\\\!\\pm\\\!0\.003^\{\(5\)\}1\.86¯±0\.173\(2\)\\underline\{1\.86\}\\\!\\pm\\\!0\.173^\{\(2\)\}1\.85¯±0\.173\(2\)\\underline\{1\.85\}\\\!\\pm\\\!0\.173^\{\(2\)\}±0\.066\(1\)\\mathbf\{6\.59\}\\\!\\pm\\\!0\.066^\{\(1\)\}±0\.067\(1\)\\mathbf\{6\.50\}\\\!\\pm\\\!0\.067^\{\(1\)\}±0\.031\(6\)1\.43\\\!\\pm\\\!0\.031^\{\(6\)\}±0\.032\(6\)1\.42\\\!\\pm\\\!0\.032^\{\(6\)\}ASTGI±0\.064\(1\)\\mathbf\{6\.55\}\\\!\\pm\\\!0\.064^\{\(1\)\}±0\.067\(1\)\\mathbf\{6\.48\}\\\!\\pm\\\!0\.067^\{\(1\)\}±0\.092\(6\)2\.19\\\!\\pm\\\!0\.092^\{\(6\)\}±0\.093\(6\)2\.18\\\!\\pm\\\!0\.093^\{\(6\)\}±0\.088\(4\)6\.69\\\!\\pm\\\!0\.088^\{\(4\)\}±0\.088\(4\)6\.60\\\!\\pm\\\!0\.088^\{\(4\)\}±0\.024\(3\)1\.38\\\!\\pm\\\!0\.024^\{\(3\)\}±0\.024\(3\)1\.38\\\!\\pm\\\!0\.024^\{\(3\)\}GRU\-D±0\.249\(10\)7\.45\\\!\\pm\\\!0\.249^\{\(10\)\}±0\.262\(10\)7\.37\\\!\\pm\\\!0\.262^\{\(10\)\}±0\.286\(8\)2\.76\\\!\\pm\\\!0\.286^\{\(8\)\}±0\.284\(8\)2\.75\\\!\\pm\\\!0\.284^\{\(8\)\}±0\.033\(10\)6\.81\\\!\\pm\\\!0\.033^\{\(10\)\}±0\.032\(10\)6\.72\\\!\\pm\\\!0\.032^\{\(10\)\}±0\.251\(9\)2\.06\\\!\\pm\\\!0\.251^\{\(9\)\}±0\.253\(9\)2\.06\\\!\\pm\\\!0\.253^\{\(9\)\}GraFITi6\.56¯±0\.033\(2\)\\underline\{6\.56\}\\\!\\pm\\\!0\.033^\{\(2\)\}6\.49¯±0\.033\(2\)\\underline\{6\.49\}\\\!\\pm\\\!0\.033^\{\(2\)\}±0\.097\(4\)1\.96\\\!\\pm\\\!0\.097^\{\(4\)\}±0\.096\(4\)1\.95\\\!\\pm\\\!0\.096^\{\(4\)\}±0\.146\(3\)6\.66\\\!\\pm\\\!0\.146^\{\(3\)\}±0\.146\(3\)6\.57\\\!\\pm\\\!0\.146^\{\(3\)\}1\.37¯±0\.012\(2\)\\underline\{1\.37\}\\\!\\pm\\\!0\.012^\{\(2\)\}1\.37¯±0\.013\(2\)\\underline\{1\.37\}\\\!\\pm\\\!0\.013^\{\(2\)\}HyperIMTS±0\.056\(7\)6\.79\\\!\\pm\\\!0\.056^\{\(7\)\}±0\.063\(7\)6\.75\\\!\\pm\\\!0\.063^\{\(7\)\}±0\.391\(3\)1\.91\\\!\\pm\\\!0\.391^\{\(3\)\}±0\.390\(3\)1\.91\\\!\\pm\\\!0\.390^\{\(3\)\}±0\.072\(8\)6\.74\\\!\\pm\\\!0\.072^\{\(8\)\}±0\.074\(8\)6\.65\\\!\\pm\\\!0\.074^\{\(8\)\}±0\.013\(1\)\\mathbf\{1\.36\}\\\!\\pm\\\!0\.013^\{\(1\)\}±0\.013\(1\)\\mathbf\{1\.36\}\\\!\\pm\\\!0\.013^\{\(1\)\}KAFNet±0\.027\(4\)6\.68\\\!\\pm\\\!0\.027^\{\(4\)\}±0\.031\(4\)6\.61\\\!\\pm\\\!0\.031^\{\(4\)\}±0\.055\(1\)\\mathbf\{1\.73\}\\\!\\pm\\\!0\.055^\{\(1\)\}±0\.056\(1\)\\mathbf\{1\.73\}\\\!\\pm\\\!0\.056^\{\(1\)\}6\.60¯±0\.092\(2\)\\underline\{6\.60\}\\\!\\pm\\\!0\.092^\{\(2\)\}6\.51¯±0\.093\(2\)\\underline\{6\.51\}\\\!\\pm\\\!0\.093^\{\(2\)\}±0\.010\(4\)1\.39\\\!\\pm\\\!0\.010^\{\(4\)\}±0\.010\(4\)1\.39\\\!\\pm\\\!0\.010^\{\(4\)\}NeuralFlow±0\.122\(8\)7\.41\\\!\\pm\\\!0\.122^\{\(8\)\}±0\.127\(8\)7\.35\\\!\\pm\\\!0\.127^\{\(8\)\}±0\.234\(10\)3\.46\\\!\\pm\\\!0\.234^\{\(10\)\}±0\.233\(10\)3\.45\\\!\\pm\\\!0\.233^\{\(10\)\}±0\.064\(9\)6\.77\\\!\\pm\\\!0\.064^\{\(9\)\}±0\.064\(9\)6\.68\\\!\\pm\\\!0\.064^\{\(9\)\}±0\.305\(11\)3\.11\\\!\\pm\\\!0\.305^\{\(11\)\}±0\.304\(11\)3\.11\\\!\\pm\\\!0\.304^\{\(11\)\}SeFT±0\.118\(9\)7\.44\\\!\\pm\\\!0\.118^\{\(9\)\}±0\.115\(9\)7\.36\\\!\\pm\\\!0\.115^\{\(9\)\}±0\.828\(11\)4\.33\\\!\\pm\\\!0\.828^\{\(11\)\}±0\.827\(11\)4\.32\\\!\\pm\\\!0\.827^\{\(11\)\}±0\.062\(6\)6\.72\\\!\\pm\\\!0\.062^\{\(6\)\}±0\.059\(5\)6\.61\\\!\\pm\\\!0\.059^\{\(5\)\}±0\.041\(10\)2\.12\\\!\\pm\\\!0\.041^\{\(10\)\}±0\.041\(10\)2\.12\\\!\\pm\\\!0\.041^\{\(10\)\}Warpformer±0\.054\(3\)6\.63\\\!\\pm\\\!0\.054^\{\(3\)\}±0\.059\(3\)6\.56\\\!\\pm\\\!0\.059^\{\(3\)\}±0\.053\(7\)2\.20\\\!\\pm\\\!0\.053^\{\(7\)\}±0\.054\(7\)2\.19\\\!\\pm\\\!0\.054^\{\(7\)\}±0\.110\(11\)7\.48\\\!\\pm\\\!0\.110^\{\(11\)\}±0\.109\(11\)7\.35\\\!\\pm\\\!0\.109^\{\(11\)\}±0\.003\(5\)1\.41\\\!\\pm\\\!0\.003^\{\(5\)\}±0\.003\(5\)1\.41\\\!\\pm\\\!0\.003^\{\(5\)\}mTAN±0\.010\(11\)7\.61\\\!\\pm\\\!0\.010^\{\(11\)\}±0\.016\(11\)7\.53\\\!\\pm\\\!0\.016^\{\(11\)\}±0\.314\(9\)2\.96\\\!\\pm\\\!0\.314^\{\(9\)\}±0\.314\(9\)2\.94\\\!\\pm\\\!0\.314^\{\(9\)\}±0\.062\(5\)6\.70\\\!\\pm\\\!0\.062^\{\(5\)\}±0\.063\(6\)6\.63\\\!\\pm\\\!0\.063^\{\(6\)\}±0\.018\(8\)1\.85\\\!\\pm\\\!0\.018^\{\(8\)\}±0\.018\(8\)1\.85\\\!\\pm\\\!0\.018^\{\(8\)\}tPatchGNN±0\.070\(6\)6\.75\\\!\\pm\\\!0\.070^\{\(6\)\}±0\.082\(6\)6\.70\\\!\\pm\\\!0\.082^\{\(6\)\}±0\.247\(5\)2\.16\\\!\\pm\\\!0\.247^\{\(5\)\}±0\.246\(5\)2\.16\\\!\\pm\\\!0\.246^\{\(5\)\}±0\.083\(7\)6\.73\\\!\\pm\\\!0\.083^\{\(7\)\}±0\.083\(7\)6\.64\\\!\\pm\\\!0\.083^\{\(7\)\}±0\.035\(7\)1\.45\\\!\\pm\\\!0\.035^\{\(7\)\}±0\.036\(7\)1\.44\\\!\\pm\\\!0\.036^\{\(7\)\} For fully synthetic data, the referenceRctR\_\{\\mathrm\{ct\}\}is computed by trapezoidal integration over a dense common time grid\. For semi\-synthetic data, it is computed as the equally weighted squared error over all 512 future grid points\. ### D\.2Real\-World Datasets We evaluate models on eight real\-world datasets spanning healthcare, climate science, human sensing, finance, software engineering, international events, and network systems\. These datasets exhibit diverse irregularity mechanisms, including event\-triggered logging, activity\-dependent collection, operational constraints, human scheduling, missing observations, and system jitter\([4](https://arxiv.org/html/2608.17293#bib.bib10)\)\. Only the numerical time\-series modalities are used\. The processed data are represented either as wide tables with one row per record and timestamp or as sparse triplets of timestamp, variable index, and value\. Sparse observations are converted into multivariate tensors with binary masks\. Filled values at unobserved positions are used only for tensor storage and do not contribute to training or evaluation\. Record identifiers are deterministically divided into training, validation, and test partitions, and forecasting windows are constructed without crossing record boundaries\. #### CESNET\. CESNET contains network traffic measurements collected from 11 devices, with 10 traffic variables\. Its irregular timestamps mainly arise from scheduling delay and logging jitter\. Raw timestamps are aggregated to minute resolution, and duplicate observations within the same minute are averaged\. We use 1,440 minutes of history to predict the following 1,440 minutes, producing 252, 84, and 126 training, validation, and test windows, respectively\. #### FNSPID\. FNSPID contains six financial variables for 10 entities, including open, high, low, close, adjusted close, and trading volume\. Observations are restricted by market operating hours, creating structured gaps between trading periods\. Timestamps are converted into relative calendar days without filling non\-trading days\. Both the historical and forecasting windows contain 30 days, resulting in 496/171/176 train/validation/test samples\. #### GDELT\. GDELT records international events and contains five numerical variables for eight event streams\. Since observations are generated when geopolitical events occur, the sampling process is naturally event\-driven\. Individual events and fractional\-day timestamps are retained without daily aggregation\. We use 14\-day historical and forecasting windows, yielding 208/52/156 train/validation/test samples\. #### HumanActivity\. HumanActivity contains 12 location variables obtained from sensors placed on the body during different human activities\. The dataset contains 25 records, and the sensors are observed at asynchronous and slightly different timestamps\. Relative timestamps are quantized, while duplicate measurements from the same sensor and timestamp are averaged\. The history and forecasting lengths are 3,000 and 1,000 time units, producing 735/264/361 train/validation/test samples\. #### MIMIC\-III\. MIMIC\-III is a large critical\-care database containing de\-identified clinical records from ICU patients\([9](https://arxiv.org/html/2608.17293#bib.bib19)\)\. We combine laboratory, input, output, and prescription events from the first 48 hours of each admission and aggregate them into half\-hour bins\. The processed data contain 22,406 admissions and 96 variables\. The first 72 bins are used as history and the following 24 bins as the forecasting horizon, resulting in 11,156/3,699/3,703 train/validation/test samples\. Its irregularity mainly reflects clinician\-driven measurements and heterogeneous clinical recording frequencies\. Table 6:Complete MAE and CAE results on MIMIC\-III, RepoHealth, StudentLife, and USHCN\. Values are mean±\\pmstandard deviation over three random seeds; standard deviations are rounded to three decimal places\.ModelMIMIC\-III×10−1\\times 10^\{\-1\}RepoHealth×10−1\\times 10^\{\-1\}StudentLife×10−1\\times 10^\{\-1\}USHCN×10−1\\times 10^\{\-1\}MAECAEMAECAEMAECAEMAECAEAPN±0\.034\(6\)4\.78\\\!\\pm\\\!0\.034^\{\(6\)\}±0\.034\(6\)4\.79\\\!\\pm\\\!0\.034^\{\(6\)\}3\.47¯±0\.049\(2\)\\underline\{3\.47\}\\\!\\pm\\\!0\.049^\{\(2\)\}3\.55¯±0\.051\(2\)\\underline\{3\.55\}\\\!\\pm\\\!0\.051^\{\(2\)\}5\.75¯±0\.017\(2\)\\underline\{5\.75\}\\\!\\pm\\\!0\.017^\{\(2\)\}±0\.017\(3\)5\.78\\\!\\pm\\\!0\.017^\{\(3\)\}±0\.235\(4\)3\.56\\\!\\pm\\\!0\.235^\{\(4\)\}±0\.291\(5\)3\.70\\\!\\pm\\\!0\.291^\{\(5\)\}ASTGI±0\.001\(11\)6\.74\\\!\\pm\\\!0\.001^\{\(11\)\}±0\.001\(11\)6\.76\\\!\\pm\\\!0\.001^\{\(11\)\}±1\.554\(7\)5\.27\\\!\\pm\\\!1\.554^\{\(7\)\}±1\.584\(7\)5\.36\\\!\\pm\\\!1\.584^\{\(7\)\}±0\.075\(3\)5\.77\\\!\\pm\\\!0\.075^\{\(3\)\}5\.77¯±0\.075\(2\)\\underline\{5\.77\}\\\!\\pm\\\!0\.075^\{\(2\)\}±0\.080\(3\)3\.11\\\!\\pm\\\!0\.080^\{\(3\)\}±0\.085\(3\)3\.21\\\!\\pm\\\!0\.085^\{\(3\)\}GRU\-D±0\.018\(7\)4\.98\\\!\\pm\\\!0\.018^\{\(7\)\}±0\.020\(7\)5\.00\\\!\\pm\\\!0\.020^\{\(7\)\}±0\.614\(11\)7\.56\\\!\\pm\\\!0\.614^\{\(11\)\}±0\.600\(11\)7\.65\\\!\\pm\\\!0\.600^\{\(11\)\}±0\.023\(8\)6\.15\\\!\\pm\\\!0\.023^\{\(8\)\}±0\.024\(8\)6\.16\\\!\\pm\\\!0\.024^\{\(8\)\}±0\.408\(11\)4\.53\\\!\\pm\\\!0\.408^\{\(11\)\}±0\.408\(11\)4\.69\\\!\\pm\\\!0\.408^\{\(11\)\}GraFITi±0\.072\(1\)\\mathbf\{4\.40\}\\\!\\pm\\\!0\.072^\{\(1\)\}4\.47¯±0\.073\(2\)\\underline\{4\.47\}\\\!\\pm\\\!0\.073^\{\(2\)\}±0\.588\(1\)\\mathbf\{3\.21\}\\\!\\pm\\\!0\.588^\{\(1\)\}±0\.587\(1\)\\mathbf\{3\.26\}\\\!\\pm\\\!0\.587^\{\(1\)\}±0\.035\(6\)5\.83\\\!\\pm\\\!0\.035^\{\(6\)\}±0\.034\(4\)5\.79\\\!\\pm\\\!0\.034^\{\(4\)\}±0\.177\(1\)\\mathbf\{2\.97\}\\\!\\pm\\\!0\.177^\{\(1\)\}±0\.191\(1\)\\mathbf\{3\.08\}\\\!\\pm\\\!0\.191^\{\(1\)\}HyperIMTS4\.46¯±0\.035\(2\)\\underline\{4\.46\}\\\!\\pm\\\!0\.035^\{\(2\)\}±0\.035\(1\)\\mathbf\{4\.41\}\\\!\\pm\\\!0\.035^\{\(1\)\}±0\.370\(3\)3\.89\\\!\\pm\\\!0\.370^\{\(3\)\}±0\.374\(3\)3\.97\\\!\\pm\\\!0\.374^\{\(3\)\}±0\.024\(1\)\\mathbf\{5\.74\}\\\!\\pm\\\!0\.024^\{\(1\)\}±0\.024\(1\)\\mathbf\{5\.76\}\\\!\\pm\\\!0\.024^\{\(1\)\}±0\.967\(8\)4\.15\\\!\\pm\\\!0\.967^\{\(8\)\}±0\.996\(8\)4\.29\\\!\\pm\\\!0\.996^\{\(8\)\}KAFNet±0\.035\(3\)4\.60\\\!\\pm\\\!0\.035^\{\(3\)\}±0\.033\(3\)4\.61\\\!\\pm\\\!0\.033^\{\(3\)\}±1\.978\(6\)5\.17\\\!\\pm\\\!1\.978^\{\(6\)\}±1\.997\(6\)5\.25\\\!\\pm\\\!1\.997^\{\(6\)\}±0\.023\(4\)5\.78\\\!\\pm\\\!0\.023^\{\(4\)\}±0\.023\(5\)5\.83\\\!\\pm\\\!0\.023^\{\(5\)\}±0\.291\(9\)4\.31\\\!\\pm\\\!0\.291^\{\(9\)\}±0\.288\(9\)4\.47\\\!\\pm\\\!0\.288^\{\(9\)\}NeuralFlow±0\.015\(8\)5\.11\\\!\\pm\\\!0\.015^\{\(8\)\}±0\.015\(8\)5\.12\\\!\\pm\\\!0\.015^\{\(8\)\}±0\.510\(10\)7\.36\\\!\\pm\\\!0\.510^\{\(10\)\}±0\.531\(10\)7\.46\\\!\\pm\\\!0\.531^\{\(10\)\}±0\.075\(10\)6\.49\\\!\\pm\\\!0\.075^\{\(10\)\}±0\.073\(10\)6\.51\\\!\\pm\\\!0\.073^\{\(10\)\}±0\.615\(5\)3\.58\\\!\\pm\\\!0\.615^\{\(5\)\}±0\.638\(6\)3\.77\\\!\\pm\\\!0\.638^\{\(6\)\}SeFT±0\.048\(9\)5\.15\\\!\\pm\\\!0\.048^\{\(9\)\}±0\.046\(9\)5\.16\\\!\\pm\\\!0\.046^\{\(9\)\}±0\.152\(8\)6\.63\\\!\\pm\\\!0\.152^\{\(8\)\}±0\.152\(8\)6\.72\\\!\\pm\\\!0\.152^\{\(8\)\}±0\.851\(11\)6\.93\\\!\\pm\\\!0\.851^\{\(11\)\}±0\.849\(11\)6\.94\\\!\\pm\\\!0\.849^\{\(11\)\}±0\.008\(10\)4\.43\\\!\\pm\\\!0\.008^\{\(10\)\}±0\.004\(10\)4\.59\\\!\\pm\\\!0\.004^\{\(10\)\}Warpformer±0\.025\(4\)4\.63\\\!\\pm\\\!0\.025^\{\(4\)\}±0\.023\(4\)4\.64\\\!\\pm\\\!0\.023^\{\(4\)\}±0\.257\(5\)4\.86\\\!\\pm\\\!0\.257^\{\(5\)\}±0\.260\(5\)4\.98\\\!\\pm\\\!0\.260^\{\(5\)\}±0\.052\(7\)5\.85\\\!\\pm\\\!0\.052^\{\(7\)\}±0\.052\(7\)5\.86\\\!\\pm\\\!0\.052^\{\(7\)\}±0\.026\(6\)3\.66\\\!\\pm\\\!0\.026^\{\(6\)\}±0\.022\(4\)3\.67\\\!\\pm\\\!0\.022^\{\(4\)\}mTAN±0\.043\(10\)5\.38\\\!\\pm\\\!0\.043^\{\(10\)\}±0\.045\(10\)5\.39\\\!\\pm\\\!0\.045^\{\(10\)\}±0\.242\(9\)6\.96\\\!\\pm\\\!0\.242^\{\(9\)\}±0\.229\(9\)7\.05\\\!\\pm\\\!0\.229^\{\(9\)\}±0\.127\(9\)6\.19\\\!\\pm\\\!0\.127^\{\(9\)\}±0\.125\(9\)6\.20\\\!\\pm\\\!0\.125^\{\(9\)\}3\.01¯±0\.106\(2\)\\underline\{3\.01\}\\\!\\pm\\\!0\.106^\{\(2\)\}3\.13¯±0\.107\(2\)\\underline\{3\.13\}\\\!\\pm\\\!0\.107^\{\(2\)\}tPatchGNN±0\.023\(5\)4\.65\\\!\\pm\\\!0\.023^\{\(5\)\}±0\.021\(5\)4\.65\\\!\\pm\\\!0\.021^\{\(5\)\}±0\.322\(4\)4\.36\\\!\\pm\\\!0\.322^\{\(4\)\}±0\.324\(4\)4\.43\\\!\\pm\\\!0\.324^\{\(4\)\}±0\.081\(5\)5\.82\\\!\\pm\\\!0\.081^\{\(5\)\}±0\.081\(6\)5\.84\\\!\\pm\\\!0\.081^\{\(6\)\}±0\.725\(7\)3\.82\\\!\\pm\\\!0\.725^\{\(7\)\}±0\.738\(7\)3\.94\\\!\\pm\\\!0\.738^\{\(7\)\} #### RepoHealth\. RepoHealth describes issue, pull\-request, and development activities from four software repositories using 10 numerical variables\. Observations become denser during active development periods and sparser during inactive periods\. Timestamps are converted into relative days, and duplicated daily observations are averaged\. We use 30\-day history and forecasting windows, with 97/59/50 train/validation/test samples\. #### StudentLife\. StudentLife contains daily mobile\-sensing measurements from 20 students, including activity, location, sleep, and phone\-use variables\. Its nine variables are irregularly observed because data availability depends on individual routines and device usage\. Both the historical and forecasting windows contain 30 days, producing 271/89/90 train/validation/test samples\. #### USHCN\. USHCN contains long\-term climate observations from 1,114 weather stations across the United States\([16](https://arxiv.org/html/2608.17293#bib.bib18)\)\. Five meteorological variables are used, and missing daily observations make the resulting trajectories sporadic\. Following the commonly used irregular forecasting protocol, the first 150 time units are used as history and the following 50 units as the forecasting horizon\. The resulting split contains 666/220/224 train/validation/test samples\. ### D\.3Baselines and Hyperparameters We compare eleven representative models covering recurrent, continuous\-time, set\-based, attention\-based, graph\-based, and pre\-alignment forecasting paradigms\. To ensure consistent comparisons, each model uses the same configuration across all real\-world datasets\. #### APN\. APN aggregates irregular observations into learnable temporal patches through soft boundaries and predicts values at arbitrary query timestamps\([15](https://arxiv.org/html/2608.17293#bib.bib17)\)\. We use hidden dimensiond=56d=56, two layers, eight attention heads, time\-embedding dimension 8, two patches, dropout 0\.1, and batch size 32\. #### ASTGI\. ASTGI directly represents each discrete observation as a point in a learnable spatio\-temporal space and adaptively constructs causal nearest\-neighbor graphs for information propagation\([14](https://arxiv.org/html/2608.17293#bib.bib24)\)\. We use hidden dimension 128, two propagation layers, time\-embedding dimension 128, channel\-embedding dimension 64, 96 candidate neighbors, MLP ratio 4, dropout 0\.1, and batch size 8\. #### GRU\-D\. GRU\-D extends recurrent models with trainable decay mechanisms that explicitly incorporate missingness masks and elapsed time between observations\([5](https://arxiv.org/html/2608.17293#bib.bib12)\)\. We use one recurrent layer with hidden dimension 128 and batch size 32\. #### GraFITi\. GraFITi represents observed and queried values as nodes in a bipartite graph and performs graph\-based information propagation for irregular forecasting\([23](https://arxiv.org/html/2608.17293#bib.bib8)\)\. We use hidden dimension 128, four graph layers, one attention head, zero dropout, and batch size 32\. #### HyperIMTS\. HyperIMTS constructs hypergraph interactions to model higher\-order dependencies among asynchronously observed variables\([13](https://arxiv.org/html/2608.17293#bib.bib14)\)\. We use hidden dimension 128, three layers, one attention head, dropout 0\.1, and batch size 32\. #### KAFNet\. KAFNet employs kernel aggregation to pre\-align irregular observations before temporal modeling\([27](https://arxiv.org/html/2608.17293#bib.bib16)\)\. We use hidden dimension 16, pre\-convolution dimension 32, one layer, one attention head, four Gaussian kernels, time\-embedding dimension 10, and batch size 32\. #### NeuralFlow\. NeuralFlow parameterizes continuous latent dynamics through an invertible flow, providing an efficient alternative to numerical ODE solvers\([2](https://arxiv.org/html/2608.17293#bib.bib13)\)\. We use hidden dimension 100, two coupling\-flow layers, latent dimension 20, time\-encoding hidden dimension 8, three hidden layers, reconstruction dimension 30, and batch size 32\. #### SeFT\. SeFT treats all irregular observations as an unordered set and uses learned set functions and attention pooling to obtain a fixed\-dimensional representation\([8](https://arxiv.org/html/2608.17293#bib.bib4)\)\. We use hidden dimension 128, threeϕ/ρ\\phi/\\rholayers, twoψ\\psilayers, four attention heads, positional dimension 4, dropout 0\.1, and batch size 32\. \(a\) Synthetic\-Regime \(b\) Synthetic\-Multiscale \(c\) ETTm1 \(d\) Weather Figure 5:Relative estimation errors of MSE and CSE with respect toRctR\_\{\\mathrm\{ct\}\}under increasing sampling non\-uniformity on all synthetic and semi\-synthetic datasets\. #### Warpformer\. Warpformer applies multiscale temporal warping to transform irregular observations into representations suitable for Transformer\-based modeling\([24](https://arxiv.org/html/2608.17293#bib.bib7)\)\. We use hidden dimension 128, three layers, inner dimension 64, one attention head, key/value dimensions of 8, and batch size 32\. #### mTAN\. mTAN employs multi\-time attention to map irregular observations onto continuous reference timestamps\([20](https://arxiv.org/html/2608.17293#bib.bib5)\)\. We use hidden dimension 128, latent dimension 32, one attention head, 128 reference points, observation standard deviation 0\.01, and batch size 32\. #### tPatchGNN\. tPatchGNN organizes irregular observations into transformable temporal patches and models variable interactions using graph neural networks\([25](https://arxiv.org/html/2608.17293#bib.bib15)\)\. We use hidden dimension 32, one graph layer, one attention head, one Transformer layer, one\-hop propagation, node\-embedding dimension 10, time\-embedding dimension 10, a linear output head, and batch size 32\. #### Controlled\-experiment baselines\. The controlled experiments use SeFT, CRU, GraFITi, tPatchGNN, and KAFNet\. SeFT uses hidden dimension 64, twoϕ/ρ\\phi/\\rholayers, twoψ\\psilayers, two attention heads, and dropout 0\.02\. CRU uses hidden dimension 20 and 20 basis functions\([19](https://arxiv.org/html/2608.17293#bib.bib3)\)\. GraFITi uses hidden dimension 28 and two graph layers\. tPatchGNN uses hidden dimension 32, patch length 4, one graph layer, and one Transformer layer\. KAFNet uses hidden dimension 64, pre\-convolution dimension 32, two layers, eight Gaussian kernels, and time\-embedding dimension 16\. Table 7:Complete model\-evaluation results on the two synthetic datasets underα=0\.9\\alpha=0\.9\. Values are mean±\\pmstandard deviation over 20 timestamp resamples;RctR\_\{\\mathrm\{ct\}\}is computed from the complete trajectory\. Superscripts denote ranks\.ModelSynthetic\-Regime×10−2\\times 10^\{\-2\}Synthetic\-Multiscale×10−2\\times 10^\{\-2\}MSECSERctR\_\{\\mathrm\{ct\}\}MSECSERctR\_\{\\mathrm\{ct\}\}SeFT±0\.0228\(3\)1\.0884\\\!\\pm\\\!0\.0228^\{\(3\)\}±0\.3760\(1\)\\mathbf\{8\.6994\}\\\!\\pm\\\!0\.3760^\{\(1\)\}6\.2552\(1\)\\mathbf\{6\.2552\}^\{\(1\)\}±0\.0058\(3\)1\.2655\\\!\\pm\\\!0\.0058^\{\(3\)\}±0\.0632\(3\)1\.1169\\\!\\pm\\\!0\.0632^\{\(3\)\}1\.1659\(3\)1\.1659^\{\(3\)\}CRU±0\.0232\(1\)\\mathbf\{0\.6527\}\\\!\\pm\\\!0\.0232^\{\(1\)\}8\.8105¯±0\.3814\(2\)\\underline\{8\.8105\}\\\!\\pm\\\!0\.3814^\{\(2\)\}6\.4831¯\(2\)\\underline\{6\.4831\}^\{\(2\)\}±0\.0055\(4\)1\.3118\\\!\\pm\\\!0\.0055^\{\(4\)\}±0\.0380\(1\)\\mathbf\{0\.8085\}\\\!\\pm\\\!0\.0380^\{\(1\)\}0\.9575\(1\)\\mathbf\{0\.9575\}^\{\(1\)\}GraFITi±0\.0233\(5\)2\.5741\\\!\\pm\\\!0\.0233^\{\(5\)\}±0\.4644\(5\)9\.8776\\\!\\pm\\\!0\.4644^\{\(5\)\}7\.6588\(5\)7\.6588^\{\(5\)\}±0\.0053\(5\)1\.6822\\\!\\pm\\\!0\.0053^\{\(5\)\}±0\.0477\(5\)1\.4708\\\!\\pm\\\!0\.0477^\{\(5\)\}1\.5059\(5\)1\.5059^\{\(5\)\}tPatchGNN0\.9132¯±0\.0241\(2\)\\underline\{0\.9132\}\\\!\\pm\\\!0\.0241^\{\(2\)\}±0\.3603\(4\)9\.3798\\\!\\pm\\\!0\.3603^\{\(4\)\}6\.9119\(4\)6\.9119^\{\(4\)\}0\.8939¯±0\.0052\(2\)\\underline\{0\.8939\}\\\!\\pm\\\!0\.0052^\{\(2\)\}±0\.0687\(4\)1\.1272\\\!\\pm\\\!0\.0687^\{\(4\)\}1\.1789\(4\)1\.1789^\{\(4\)\}KAFNet±0\.0232\(4\)1\.5435\\\!\\pm\\\!0\.0232^\{\(4\)\}±0\.3602\(3\)9\.0437\\\!\\pm\\\!0\.3602^\{\(3\)\}6\.7512\(3\)6\.7512^\{\(3\)\}±0\.0057\(1\)\\mathbf\{0\.8088\}\\\!\\pm\\\!0\.0057^\{\(1\)\}1\.0751¯±0\.0511\(2\)\\underline\{1\.0751\}\\\!\\pm\\\!0\.0511^\{\(2\)\}1\.1567¯\(2\)\\underline\{1\.1567\}^\{\(2\)\} ### D\.4Training and Evaluation Details #### Training protocol\. All models are trained using the Adam optimizer and masked observation\-point MSE\. For prediction maskmbidm\_\{bid\}, the training objective is ℒtrain=∑b,i,dmbid\(y^bid−ybid\)2∑b,i,dmbid\.\\mathcal\{L\}\_\{\\mathrm\{train\}\}=\\frac\{\\sum\_\{b,i,d\}m\_\{bid\}\\left\(\\widehat\{y\}\_\{bid\}\-y\_\{bid\}\\right\)^\{2\}\}\{\\sum\_\{b,i,d\}m\_\{bid\}\}\.\(48\)All baselines are trained for 100 epochs, and the checkpoint with the lowest validation MSE is retained for testing\. The learning rate is10−310^\{\-3\}for all models\. NeuralFlow and mTAN use weight decay10−410^\{\-4\}, while the remaining real\-world baselines use no weight decay\. Models that originally employ probabilistic objectives, including mTAN and NeuralFlow, are also optimized using the common MSE objective to ensure a unified training protocol\. The controlled experiments use learning rate10−310^\{\-3\}, weight decay10−510^\{\-5\}, batch size 64, and global gradient\-norm clipping at 1\.0\. Training and validation target timestamps are uniformly sampled from the future interval\. All model–dataset experiments are independently repeated with three random seeds, 2024, 2025, and 2026\. We report the mean and standard deviation across the three runs\. In the controlled sampling\-shift experiment, each trained checkpoint is further evaluated using 20 independent timestamp resamples for each sampling strengthα\\alpha\. #### Temporal\-density estimation\. Future timestamps are mapped to the common forecasting interval\[0,1\]\[0,1\]before density estimation\. We use a trajectory\-specific leave\-one\-out Gaussian kernel density estimator\. The bandwidth follows a robust Silverman rule: hs=max\{0\.9min\(σs,IQRs1\.34\)Ls−1/5,1max\(20,2Ls\),10−6\}\.h\_\{s\}=\\max\\left\\\{0\.9\\min\\left\(\\sigma\_\{s\},\\frac\{\\operatorname\{IQR\}\_\{s\}\}\{1\.34\}\\right\)L\_\{s\}^\{\-1/5\},\\frac\{1\}\{\\max\(20,2L\_\{s\}\)\},10^\{\-6\}\\right\\\}\.\(49\)Non\-positive scale estimates are excluded when computing the minimum\. Estimated densities are lower\-bounded by10−810^\{\-8\}, and no importance\-weight clipping or boundary reflection is applied\. Conditional and marginal timestamp densities are estimated only from test timestamps and are shared by all models evaluated on the same dataset\. #### Metric computation\. For each model–dataset–seed combination, the selected checkpoint is loaded once, and MSE, GSE, and CSE are computed from the same test predictions\. Letmsidm\_\{sid\}indicate whether variableddis observed at future timestampts,it\_\{s,i\}and letws,iw\_\{s,i\}denote the corresponding temporal weight\. The trajectory\-level weighted error is R^s\(w\)=∑i,dmsidws,i\(y^sid−ysid\)2∑i,dmsidws,i\.\\widehat\{R\}\_\{s\}\(w\)=\\frac\{\\sum\_\{i,d\}m\_\{sid\}w\_\{s,i\}\\left\(\\widehat\{y\}\_\{sid\}\-y\_\{sid\}\\right\)^\{2\}\}\{\\sum\_\{i,d\}m\_\{sid\}w\_\{s,i\}\}\.\(50\)The observation\-distribution, global\-time, and continuous\-time weights are ws,iobs\\displaystyle w^\{\\mathrm\{obs\}\}\_\{s,i\}=1,\\displaystyle=1,\(51\)ws,iglobal\\displaystyle w^\{\\mathrm\{global\}\}\_\{s,i\}=p^T\(ts,i\)p^\(ts,i∣Xs\),\\displaystyle=\\frac\{\\widehat\{p\}\_\{T\}\(t\_\{s,i\}\)\}\{\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\},ws,ict\\displaystyle w^\{\\mathrm\{ct\}\}\_\{s,i\}=1p^\(ts,i∣Xs\)\.\\displaystyle=\\frac\{1\}\{\\widehat\{p\}\(t\_\{s,i\}\\mid X\_\{s\}\)\}\.Each trajectory is normalized independently, after which the trajectory\-level errors are averaged with equal weight\. Padding positions and timestamps without any observed target variables are excluded from both density estimation and metric computation\. #### Implementation environment\. All experiments are implemented in Python 3\.12 and PyTorch 2\.10\.0 with CUDA 12\.8\. Training and evaluation are conducted on NVIDIA GeForce RTX 4090 GPUs\. ## Appendix EAdditional Experimental Results ### E\.1Complete Results on Synthetic and Semi\-Synthetic Data Figure[5](https://arxiv.org/html/2608.17293#A4.F5)reports the relative estimation errors of MSE and CSE with respect toRctR\_\{\\mathrm\{ct\}\}on all four controlled datasets\. The curves show the mean over 20 independent test\-timestamp resamples, and the shaded regions denote one standard deviation\. Because the trained models and underlying future trajectories remain fixed across different values ofα\\alpha, the observed changes are caused solely by the shift in the test\-time sampling distribution\. Table 8:Complete model\-evaluation results on the two semi\-synthetic datasets underα=0\.9\\alpha=0\.9\. Values are mean±\\pmstandard deviation over 20 timestamp resamples;RctR\_\{\\mathrm\{ct\}\}is computed on the complete future grid\. Superscripts denote ranks\.ModelETTm1×100\\times 10^\{0\}Weather×10−1\\times 10^\{\-1\}MSECSERctR\_\{\\mathrm\{ct\}\}MSECSERctR\_\{\\mathrm\{ct\}\}SeFT±0\.0059\(4\)1\.1032\\\!\\pm\\\!0\.0059^\{\(4\)\}±0\.0153\(4\)1\.1145\\\!\\pm\\\!0\.0153^\{\(4\)\}1\.1130\(4\)1\.1130^\{\(4\)\}±0\.0146\(5\)4\.4046\\\!\\pm\\\!0\.0146^\{\(5\)\}±0\.0629\(5\)4\.9629\\\!\\pm\\\!0\.0629^\{\(5\)\}4\.8493\(5\)4\.8493^\{\(5\)\}CRU±0\.0058\(5\)1\.3394\\\!\\pm\\\!0\.0058^\{\(5\)\}±0\.0153\(3\)1\.1001\\\!\\pm\\\!0\.0153^\{\(3\)\}1\.0994\(3\)1\.0994^\{\(3\)\}±0\.0144\(1\)\\mathbf\{3\.0839\}\\\!\\pm\\\!0\.0144^\{\(1\)\}±0\.0667\(3\)4\.6087\\\!\\pm\\\!0\.0667^\{\(3\)\}4\.4631\(3\)4\.4631^\{\(3\)\}GraFITi±0\.0056\(3\)1\.0886\\\!\\pm\\\!0\.0056^\{\(3\)\}±0\.0163\(5\)1\.4140\\\!\\pm\\\!0\.0163^\{\(5\)\}1\.4016\(5\)1\.4016^\{\(5\)\}±0\.0147\(4\)3\.8918\\\!\\pm\\\!0\.0147^\{\(4\)\}±0\.0665\(4\)4\.9221\\\!\\pm\\\!0\.0665^\{\(4\)\}4\.7612\(4\)4\.7612^\{\(4\)\}tPatchGNN0\.9251¯±0\.0056\(2\)\\underline\{0\.9251\}\\\!\\pm\\\!0\.0056^\{\(2\)\}±0\.0151\(1\)\\mathbf\{0\.9330\}\\\!\\pm\\\!0\.0151^\{\(1\)\}0\.9302\(1\)\\mathbf\{0\.9302\}^\{\(1\)\}±0\.0181\(3\)3\.8789\\\!\\pm\\\!0\.0181^\{\(3\)\}±0\.0645\(1\)\\mathbf\{3\.6856\}\\\!\\pm\\\!0\.0645^\{\(1\)\}3\.5274\(1\)\\mathbf\{3\.5274\}^\{\(1\)\}KAFNet±0\.0056\(1\)\\mathbf\{0\.9093\}\\\!\\pm\\\!0\.0056^\{\(1\)\}0\.9640¯±0\.0155\(2\)\\underline\{0\.9640\}\\\!\\pm\\\!0\.0155^\{\(2\)\}0\.9584¯\(2\)\\underline\{0\.9584\}^\{\(2\)\}3\.4839¯±0\.0144\(2\)\\underline\{3\.4839\}\\\!\\pm\\\!0\.0144^\{\(2\)\}3\.7783¯±0\.0607\(2\)\\underline\{3\.7783\}\\\!\\pm\\\!0\.0607^\{\(2\)\}3\.6496¯\(2\)\\underline\{3\.6496\}^\{\(2\)\} Under uniform sampling, the inverse\-density weights are constant and CSE consequently reduces to MSE\. Asα\\alphaincreases, observations become increasingly concentrated in a limited portion of the future interval\. MSE therefore places disproportionate emphasis on densely sampled regions, and its deviation fromRctR\_\{\\mathrm\{ct\}\}generally increases\. In contrast, CSE compensates for this concentration through inverse\-density weighting and remains substantially closer toRctR\_\{\\mathrm\{ct\}\}under strong non\-uniform sampling\. Although density estimation and importance weighting may introduce additional finite\-sample variability, the correction becomes increasingly beneficial as the mismatch between the observed and uniform temporal distributions grows\. The consistent behavior on ETTm1 and Weather further shows that this advantage is not restricted to analytically generated trajectories\. Tables[7](https://arxiv.org/html/2608.17293#A4.T7)and[8](https://arxiv.org/html/2608.17293#A5.T8)report the complete model\-level results underα=0\.9\\alpha=0\.9\. On all four datasets, CSE recovers exactly the same ranking of the five models asRctR\_\{\\mathrm\{ct\}\}, whereas MSE produces at least one ranking inversion\. This result indicates that the effect of temporal sampling is not limited to a uniform shift in metric values: different models are affected to different degrees because their prediction errors vary differently over time\. Correcting the target\-time distribution therefore improves both risk estimation and the recovery of model comparisons, supporting the main\-text conclusion that CSE more accurately reflects continuous\-time predictive performance under non\-uniform sampling\. ### E\.2Complete Results on Real\-World Datasets Tables[3](https://arxiv.org/html/2608.17293#A1.T3)and[4](https://arxiv.org/html/2608.17293#A3.T4)report the complete MSE and CSE results on the eight real\-world datasets, including standard deviations over three random seeds\. Tables[5](https://arxiv.org/html/2608.17293#A4.T5)and[6](https://arxiv.org/html/2608.17293#A4.T6)provide the corresponding MAE and Continuous\-Time Absolute Error \(CAE\) results\. The best and second\-best mean values are shown in bold and underlined, respectively, and superscripts denote ranks computed from the unrounded means\. Consistent with the observations in the main text, CSE is neither a fixed\-direction nor a fixed\-ratio transformation of MSE\. On CESNET, FNSPID, GDELT, and HumanActivity, CSE is generally lower than MSE, whereas the opposite trend is more common on MIMIC\-III, RepoHealth, and USHCN\. Moreover, even within the same dataset, the magnitude of the change varies across models\. This confirms that the sampling distribution interacts with model\-specific temporal error patterns rather than simply applying a dataset\-level scaling factor\. The reported standard deviations also distinguish this systematic metric effect from training variability: most model–dataset combinations remain relatively stable across seeds, although datasets such as RepoHealth and USHCN exhibit larger variation for several models\. The MAE–CAE comparison exhibits a similar pattern\. The direction of the correction is broadly consistent with the MSE–CSE comparison, while its magnitude remains dependent on both the dataset and the model\. In particular, the best\-performing model on MIMIC\-III changes from GraFITi under MAE to HyperIMTS under CAE, accompanied by additional local rank changes on several datasets\. Therefore, the discrepancies reported in the main text are not specific to squared error, but arise more generally from the temporal distribution under which pointwise prediction losses are aggregated\. Since the complete continuous trajectories of real\-world datasets are unavailable, these results do not directly identify which metric is exact; rather, the systematic differences suggest that relying solely on observation\-point metrics may not fully characterize models’ continuous\-time predictive performance\. langley00
Similar Articles
Rethinking Multimodal Time-Series Forecasting Evaluation
Introduces TimesX, a new multimodal time-series forecasting benchmark with diverse real-world data and textual contexts, addressing generalization, data leakage, and context diversity issues.
A Critical Audit of Spatiotemporal Forecasting Benchmark Datasets and Baselines
This paper critically audits benchmark datasets and baselines for spatiotemporal forecasting, showing that classical linear models often compete with graph neural networks, highlighting issues with discriminative reliability and advocating for more rigorous evaluation.
Beyond Holistic Models: Systematic Component-level Benchmarking of Deep Multivariate Time-Series Forecasting
This paper introduces TSCOMP, a large-scale benchmark that systematically decomposes deep multivariate time-series forecasting methods into fine-grained components to enable automated model selection, outperforming complex holistic architectures.
Do Time Series Foundation Model Benchmarks Hide Regime-Dependent Failures? Evidence from Traffic Speed Forecasting
This paper introduces regime-stratified evaluation for time series foundation models, revealing that aggregate metrics hide severe failures during traffic regime transitions, and proposes bimodal mixture augmentation to improve coverage while preserving overall accuracy.
TS-Fault: Benchmarking Time Series Forecasters Against Structural Faults
This paper introduces TS-Fault, a benchmark for evaluating time series forecasting models under structured fault scenarios like broken dependencies and regime changes, finding that clean-data accuracy often anti-correlates with robustness and that foundation models are especially fragile.