Beyond Holistic Models: Systematic Component-level Benchmarking of Deep Multivariate Time-Series Forecasting
Summary
This paper introduces TSCOMP, a large-scale benchmark that systematically decomposes deep multivariate time-series forecasting methods into fine-grained components to enable automated model selection, outperforming complex holistic architectures.
View Cached Full Text
Cached at: 06/01/26, 11:20 AM
Paper page - Beyond Holistic Models: Systematic Component-level Benchmarking of Deep Multivariate Time-Series Forecasting
Source: https://huggingface.co/papers/2605.26562
Abstract
A large-scale benchmark systematically decomposes deep forecasting methods into fine-grained components to enable automated model selection and outperform complex architectures.
While previous research inmultivariate time series forecastinghas focused on developing complex holistic models, this work advocates for a shift toward a granular,component-level understandingof their impacts. We propose TSCOMP, the first large-scale benchmark that systematically deconstructsdeep forecasting methodsinto their core,fine-grained components--spanningseries preprocessing,encoding strategies,network architecturesincluding specific and largetime-series models, andoptimization methods. Usingconstrained orthogonal experimental designand extensive evaluations, we conductmulti-view analysesthat reveal component effectiveness across different backbones, data characteristics, and their interactions. Beyond providing insights, this benchmark establishes a fine-grained performance corpus comprising over 20,000 model-dataset evaluations, which supports the learning ofautomated component selection, enablingzero-shot model constructionon new datasets. Our experiments demonstrate that the corpus-driven approach, despite its simplicity, consistently outperforms state-of-the-art methods, validating the soundness of our evaluation design and confirming that systematic component selection surpasses manually designed complex architectures. All code and the performance corpus are publicly available at https://github.com/SUFE-AILAB/TSCOMP.
View arXiv pageView PDFGitHub17Add to collection
Get this paper in your agent:
hf papers read 2605\.26562
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.26562 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.26562 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.26562 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
TS-Fault: Benchmarking Time Series Forecasters Against Structural Faults
This paper introduces TS-Fault, a benchmark for evaluating time series forecasting models under structured fault scenarios like broken dependencies and regime changes, finding that clean-data accuracy often anti-correlates with robustness and that foundation models are especially fragile.
Assessing the Operational Viability of Foundation Models for Time Series Forecasting
This paper presents an applied evaluation of foundation models for time series forecasting compared to supervised approaches across four operational domains, and proposes a Complexity Router to selectively assign series to the optimal model class for balancing accuracy and inference cost.
Rethinking Multimodal Time-Series Forecasting Evaluation
Introduces TimesX, a new multimodal time-series forecasting benchmark with diverse real-world data and textual contexts, addressing generalization, data leakage, and context diversity issues.
Retrieval Mechanisms Surpass Long-Context Scaling in Time Series Forecasting
This academic paper challenges the effectiveness of long-context scaling in time series forecasting, demonstrating that retrieval-based methods outperform standard architectures like PatchTST and foundation models such as Chronos and Moirai.
How does a 102M-parameter transformer forecast multivariate time series?
This article provides a visual walkthrough of t0-alpha, a 101.6M-parameter foundation model for multivariate time-series forecasting that separates time attention from cross-variable group attention, achieving competitive CRPS scores on GIFT-Eval compared to larger models like TimesFM 2.5 and Chronos-2.