Anomalies in Multivariate Time Series Benchmarks Are Mostly Univariate
Summary
This paper introduces a diagnostic framework for multivariate time series anomaly detection benchmarks and finds that labeled anomalies are mostly detectable from individual channels, challenging the need for cross-channel modeling. The authors call for more structurally diverse evaluation sets.
View Cached Full Text
Cached at: 06/03/26, 09:39 AM
# Anomalies in Multivariate Time Series Benchmarks Are Mostly Univariate Source: [https://arxiv.org/abs/2606.02670](https://arxiv.org/abs/2606.02670) [View PDF](https://arxiv.org/pdf/2606.02670) > Abstract:Many recent multivariate time series anomaly detection \(MT\-SAD\) models incorporate cross\-channel modeling, under the implicit assumption that the structure of anomalies may be spread across multiple channels\. We evaluate this assumption on eight widely used public benchmarks by introducing a per\-segment diagnostic framework that flags, for each labeled anomaly, whether at least one channel deviates individually from its normal history, whether the cross\-channel correlation structure changes, or both\. The framework shows that no crosschannel rupture occurs without an accompanying univariate deviation across a range of reasonable thresholds\. A complementary metric also reveals that on six of the eight benchmarks, at least half of the labeled anomaly segments deviate univariately on 79% to 100% of their timesteps, reaching 100% on three of these datasets\. To verify that our framework captures cross\-channel structure when present, we construct synthetic data of phase\-shifted sinusoidal channels with shared noise\. Each anomalous segment is altered through one of two channelwise corruptions that preserve the per\-channel marginal distribution while breaking cross\-channel structure, and our framework correctly characterizes these segments as cross\-channel\-only\. On these data, channel\-dependent \(CD\) models successfully exploit the cross\-channel signal whereas channel\-independent \(CI\) ones fail\. The CI/CD comparison of a recent SOTA detector on real benchmarks further confirms that CD modeling brings no measurable gain\. We conclude that current MTSAD benchmarks are unsuitable for validating cross\-channel modeling capabilities, and we call for the development of more structurally diverse evaluation sets\. The code for this study is publicly available\. ## Submission history From: Marc Pinet \[[view email](https://arxiv.org/show-email/637a5376/2606.02670)\] \[via CCSD proxy\] **\[v1\]**Mon, 1 Jun 2026 11:42:35 UTC \(153 KB\)
Similar Articles
CALAD: Channel-Aware contrastive Learning for multivariate time series Anomaly Detection
Proposes CALAD, a channel-aware contrastive learning framework for multivariate time series anomaly detection that uses estimated channel relevance to construct contrastive samples, achieving state-of-the-art performance.
Detecting Time Series Anomalies Like an Expert: A Multi-Agent LLM Framework with Specialized Analyzers
The article introduces SAGE, a multi-agent LLM framework for time-series anomaly detection that uses specialized analyzers to improve interpretability and reliability. It demonstrates superior performance over baselines on three benchmarks and enhances diagnostic reporting through structured evidence consolidation.
From Benchmark Performance to Tool Deployment: Human-in-the-Loop Anomaly Detection
This paper evaluates 19 unsupervised anomaly detection models on the BowTie manufacturing dataset, finding performance less stable than benchmarks suggest, and presents a deployed human-in-the-loop framework for manufactured-part inspection.
Towards Principled Continual Anomaly Detection: A Systematic Framework and Benchmark Scenarios
This paper introduces a systematic framework for designing reproducible continual anomaly detection benchmarks from tabular datasets, and provides five benchmark scenarios from three cybersecurity datasets.
Knowledge-Assisted Multi-Graph Dependency Learning for Multivariate Time Series Anomaly Detection in Multi-Stage Industrial Processes
Proposes a knowledge-assisted multi-graph framework for multivariate time series anomaly detection in multi-stage industrial processes, incorporating sensor group and process flow knowledge to enhance graph neural network-based dependency modeling.