Scaling Time Series Classification via XAI-Driven Data Reduction
Summary
This paper introduces drXAI, a method that uses XAI attribution to reduce data size for time series classification, achieving 80-90% data reduction while maintaining accuracy, enabling large models to scale.
View Cached Full Text
Cached at: 07/20/26, 09:31 AM
# Scaling Time Series Classification via XAI-Driven Data Reduction
Source: [https://arxiv.org/html/2607.15774](https://arxiv.org/html/2607.15774)
11institutetext:School of Computer Science, University College Dublin, Ireland
11email:davide\.serramazza@ucdconnect\.ie
11email:\{thach\.lenguyen,georgiana\.ifrim\}@ucd\.ie###### Abstract
Explainable AI \(XAI\) for time series has seen significant algorithmic growth, but its utility in providing measurable performance gains for downstream tasks remains under\-explored\. This paper bridges this gap by introducing drXAI, a novel methodology that repurposes XAI attribution methods for effective data reduction in Time Series Classification \(TSC\)\. The core challenge in modern TSC is scalability; state\-of\-the\-art models, such as Transformers, exhibit quadratic complexity relative to sequence length and linear complexity relative to the number of channels\. This renders them computationally prohibitive for massive datasets\. drXAI addresses this by using a fast, GPU\-accelerated classifier \(Hydra\) to generate local attributions\. We aggregate these into global feature importance scores and employ an automated elbow\-cut heuristic to select the most salient features without requiring manual thresholds\. We evaluate our approach on both synthetic and real\-world univariate and multivariate datasets\. On synthetic benchmarks, drXAI successfully recovers ground\-truth features where traditional baselines fail\. On real\-world data, drXAI achieves 80–90% data reduction while maintaining classification accuracy comparable to models trained on the full dataset\. Most importantly, we show that drXAI allows resource\-intensive models like ConvTran to scale to datasets that were previously inaccessible due to memory constraints\. Our results show the benefits of using XAI not just for interpretability, but as a robust tool for feature selection and scalability in time series analysis\. All our code and data are openly available\.
## 1Introduction
The field of Explainable AI \(XAI\) has experienced significant growth in recent years, particularly within the Time Series Classification \(TSC\) domain\. A major focus of XAI is feature attribution, which quantifies the importance of input features for the model predictions\. This area has seen considerable advances in the efficiency and effectiveness of attribution methods for time series data\[theissler2022\]\.
Despite these algorithmic advancements, the utility of XAI as a tool for achieving measurable performance gains in other computational tasks remains underexplored\. Our work offers a paradigm shift: viewing XAI not only as interpreting complex models but also as a practical tool for enhancing model efficiency and scalability\. This paper bridges this gap by introducingdrXAI \(Data Reduction with XAI\), a novel attribution\-agnostic methodology that repurposes attribution methods for effective feature selection in TSC\. For many State\-of\-the\-Art \(SOTA\) TSC models, the time complexitygrows linearly with the number of features or even quadraticallywith sequence length \(e\.g\., transformers\); additionally, these models also require a huge amount of memory\. This computational burden is often a limitation for training on massive, high\-dimensional datasets\. A way to scale these models is to train them on a reduced, yet highly informative, set of features\. Our work directly enables this by using XAI to identify the most important features, thus reducing data dimensionality without sacrificing critical information\. To our knowledge, this work is the first to use XAI for feature selection to scale time series classification methods\.
drXAI is awrapperfeature selection method that operates in two stages: it first trains a TSC model, referred to as theexplainer classifier, and then generates explanations for its predictions\. In this work, accounting for speed, we use the GPU implementation of Hydra\[dempster2024highly\]as the explainer classifier, restrict attribution to theexplainer set, a subset of the training set, and apply lightweight explainers such as Feature Ablation\.
For Multivariate Time Series Classification \(MTSC\) datasets, we focus on*channel selection*\. We propose a fast approach to compute global channel importance by aggregating the local attribution values, ranking the channels, and selecting a subset\. We then retrain SOTA classifiers on the reduced data and measure the accuracy and computational gains\. For UTSC datasets, we apply the same algorithm for computing global time point importance, which is then used for data reduction via consecutive*time point selection*\. This is especially effective for very long time series, where SOTA TSC methods do not scale well due to the requirement of extensive computational resources\.
Our main contributions in this paper are:
1. 1\.We developdrXAI, a general framework that leverages XAI attribution to select features from MTSC and UTSC datasets\. The algorithm is attribution\-agnostic and is general enough to support both channel and time\-point selection\. As part of this, we also investigate thebackground dataused for simulating data missingness in attribution methods and proposeProto, a single\-instance background outperforming the standard zeros baseline common in popular attribution methods\[kokhlikyan2020captum\]\.
2. 2\.Using synthetic MTSC data, we show that drXAI selects only informative channels, unlike baseline methods\. On synthetic UTSC data, it successfully selects over 90% of relevant features, whereas baselines are limited to at most 33%\. On real\-world datasets, drXAI provides the best trade\-off between data reduction and accuracy, most of the time matching the models trained on all features, for both MTSC and UTSC experiments\.
3. 3\.We demonstrate that by using a fast classifier \(Hydra\) and an attribution method \(Feature Ablation\) for data selection, we can effectively train more accurate but resource\-intensive models \(e\.g\., ConvTran, MultiRocket\-Hydra\[middlehurst2023bake\]\)\. This enables computationally expensive models to train successfully, overcoming the bottleneck in use cases where the model cannot be trained on the entire dataset due to memory limits\.
4. 4\.To encourage further research and reproducibility in this area, we make all our data and code publicly available111[https://github\.com/mlgig/drXAI](https://github.com/mlgig/drXAI)\.
## 2Background
### 2\.1Problem Definition
We represent a time series datasetDDas a tensor, of dimensionsn×d×Ln\\times d\\times Lwherenn,dd, andLLrespectively represent the number of samples, channels, and time points in the data\. In the UTS case,d=1d=1\.
A \(trained\) classification modelclfclfpredicts the classcic\_\{i\}of a time series instanceDiD\_\{i\}\(1≤i≤n1\\leq i\\leq n\)\. An explainerexpexpexplains theclfclfpredictions onDDby producing a set of attribution maps𝒜\\mathcal\{A\}, a tensor of attributions with the same dimensions asDD\(n×d×Ln\\times d\\times L\) where𝒜i,j,k\\mathcal\{A\}\_\{i,j,k\}indicates the attribution \(i\.e\., relevance\) ofDi,j,kD\_\{i,j,k\}for the prediction of the modelclfclfon the instanceDiD\_\{i\}\.
We denote the set of features asF=\{f1,f2,…,fm\}\{F\}=\\\{f\_\{1\},f\_\{2\},\\dots,f\_\{m\}\\\}wheremmis the total number of features\. Each feature represents a portion of the time\-series data, e\.g\., data within the same time segment, the same time step, or the same channel\. The union of all features is the complete time series\. We focus on the task of selecting a subset of featuresFsel⊂FF\_\{sel\}\\subset F\. We informally refer to this new set asselected features, denoting asDFselD\_\{F\_\{sel\}\}the new dataset containing only these features\.
In this work, we focus on data reduction for TSC, organised into two subtasks: the*channel selection*problem for MTSC datasets and*time points selection*for UTSC datasets\. For the former, each feature represents a channel \(m=dm=d\) while for the latter, each feature represents a time point \(m=Lm=L\)\. To avoid confusion, we specify which type of features we focus on when describing specific data reduction tasks\.
### 2\.2Time Series Classification
Recent work in TSC has significantly advanced the availability of extensive TSC benchmarks\[uea\-mtsc\-archive,dempster2025monstermonashscalabletime\]as well as the accuracy and efficiency of TSC algorithms\[foumani2024improving,dempster2024highly\]\. While many algorithms achieve top accuracy on benchmarks, they are resource\-intensive, especially for large\-scale datasets or very long time series\[middlehurst2023bake\]\. We discuss a few relevant SOTA classifiers, as well as their computational complexity\.
Explainer Classifier\.Our proposed method, drXAI, is a wrapper method for feature selection and requires a fast classifier to be explained\.Hydrais a TStransformationalgorithm combining convolution\-based and dictionary\-based aspects:gggroups ofkkconvolutional kernels slide over the TS, and for each group, the closest\-matching kernels are counted at each time\-point\. Features are then fed to a Ridge Classifier\. The time complexity of Hydra is dominated by the convolution and the competitive counting process\. Since k is usually a fixed constant, the time complexity is effectively linearO\(ndL\)O\(ndL\)\. Hydra’s memory complexity isO\(nk\+kd\)O\(nk\+kd\)\. In our experiments, we used the fast Hydra GPU implementation from\[dempster2024highly\], which scales well to very large datasets\.
SOTA Time Series Classifiers\.To assess the quality of data selectionFselF\_\{sel\}, we trained the following 3 SOTA classifiers on the reduced datasetsDFselD\_\{F\_\{sel\}\}\.
MultiRocket\-Hydra \(MRH\)\[middlehurst2023bake\]uses the Hydra features concatenated with those from MultiRocket\[tan2022multirocket\]\. MultiRocket applies kernels also to the first\-order difference of the series and extracts features via 4 pooling operators \(MPV, MIPV, LSPV, PPV\)\. The MultiRocket pipeline is heavier computationally than Hydra\. While still linear in the inputs, the constants for MultiRocket are larger, as well as the number of features extracted \(by default around 50,000 features\), which makes it more expensive both time and memory wise, especially for long time series\. Moreover, since by default each kernel is applied to at most 8 random channels, both algorithms also benefit from selections shorter than 8 channels\. Beyond efficiency, restricting the input to informative features can further improve model robustness and accuracy\.
ConvTran\[foumani2024improving\]is a recent transformer model, tailored for MTSC\. It extracts features from the raw series using convolutional layers that are then fed into the transformer after tokenization\. ConvTran comes with a significant jump in complexity as compared to Hydra\. While Hydra uses random kernels and a linear classifier, ConvTran is a fully trainable Transformer\-CNN hybrid that utilizes self\-attention\. ConvTran’s complexity is driven by the quadratic nature of the attention mechanism and the parameters of its convolutional embedding layers\. Its cost is quadratic w\.r\.t the series lengthO\(nL2dembedding\)O\(nL^\{2\}d\_\{embedding\}\)and linear w\.r\.t the number of channels\. For very long sequences whereL\>1000L\>1000, this becomes significantly slower than Hydra’sO\(nL\)O\(nL\)\.
InceptionTime\[ismail2020inceptiontime\]is another deep learning classifier, specifically, an ensemble method composed of 5 vanilla Inception networks \(CNN\)\. Its complexity is primarily determined by its deepInceptionmodules, which apply parallel convolutions of varying kernel sizes through bottleneck layers, capturing both local and long\-range temporal relationships\. Unlike ConvTran, InceptionTime is linear with respect to sequence length and channels, but since it requires backpropagation, the constant factors and hardware requirements are much higher than those of Hydra\.
### 2\.3XAI Methods for Time Series Classification
Our methodology isattribution\-method agnostic, i\.e\., it requires only an attribution map as input, regardless of which algorithm computed it\. In this work, we select twopermutation\-basedattribution methods that were adapted for TS and work efficiently in this domain\[serramazza2024improving,turbe2023evaluation\]\. These methods require abackground setto simulate data missingness when computing the attribution\. Nogradient\-basedattribution methods were considered for this study primarily because they can’t work with non\-gradient\-based algorithms, like Hydra and MultiRocket\. For the rest of this paper, we useexplainersto refer to the XAI attribution methods\.
Shapley Value Sampling \(SVS\)is an approximation of theShapley valuesas described in the original work\[lundberg2017unified\]\. It applies sampling to the SHAP formula, randomly permuting the features to be explained, adding them sequentially to each sample in the background set\. The attribution values are the change in the model output resulting from these substitutions\. Although shown to be effective with regard to pointing out important features\[serramazza2023evaluating\], this method requires a vast amount of computation time, due to the high number of feature permutations\. Some adaptations for time series, such as grouping features through TS segmentation, have been shown to drastically reduce computation time, while preserving accuracy\[serramazza2024improving\]\.
Feature Ablation \(FA\)\[kokhlikyan2020captum\]is much simpler and faster when compared to SHAP\. It sequentially replaces each feature with the corresponding values of the samples found in the background dataset\. As for SVS, the attribution values are the differences in the model output after substituting feature values\.
We used the implementations provided in\[serramazza2024short\]for both explainers\.
### 2\.4Feature Selection for TSC
We first discuss recent work onchannel selection for MTSC\. In\[dhariyal2023scalable\], the authors propose a supervised algorithm for selecting a subset of channels for MTSC datasets\. The algorithm has two variants, ECS and ECP, where the channels are selected based on their discriminative power, estimated using the Euclidean distance between class centroids: a higher distance implies higher discriminative power\. According to the original paper, thisfiltermethod can reduce, on average, 70% of the data without compromising the accuracy of classifiers\. Another recent work that directly compares to ECS and ECP is TSelect\[nuyts2025tselect\], awrappermethod which trains for each channel a Logistic Regression classifier based on 5 computationally cheap features extracted channel\-wise\. These models are then used to determine which of the relative channels to retrain: various filters based on these model accuracies, redundant predictions, etc\., select which channels to discard\.
Reduction of time series data can also be performed by projecting the high\-dimensional time series to a lower\-dimensional latent space\[data\-reduction\-survey\]\. Known methods include Autoencoders, Principal Component Analysis, Singular Value Decomposition, Discrete Fourier/Wavelet Transform, and Down\-sampling\. However, these aredimensionality reduction techniquesthat project time series into a different space, losing the original features\. For many applications, it is important to keep the data in the original representation to be able to audit important features, for example, medical applications such as monitoring human health\. Therefore, these transformation methods are outside the scope of this paper\.
Fortime point selection techniques for UTSC, a simple and effective approach, especially for long time series, is to useRandom Forest importance\(RFI\), using the importance \(impurity reduction\) of each feature computed during training\. Another alternative is theMutual Information\(MI\) between each feature and targets for a TSC task\[scikit\-learn\]\.
## 3Proposed Methodology
In this section, we describedrXAI, our algorithm for time series data reduction using XAI attribution methods to identify and select important features from TSC datasets\.
Algorithm 1drXAI Algorithm to Select a Feature Subset from a Time Series Dataset1:
clfclf,
expexp,
DD,
nsampn\_\{samp\}⊳\\trianglerightexplainer classifier, explainer, train set, n\. samples per class
2:Train
clfclfon
DD
3:
DexpD\_\{exp\}= sample
nsampn\_\{samp\}per class
4:
𝒜=\\mathcal\{A\}=Explain
clfclfclassifications for samples in
DexpD\_\{exp\}using
expexp
5:
A=\{A\}=equation \([1](https://arxiv.org/html/2607.15774#S3.E1)\) if channel selection else equation \([2](https://arxiv.org/html/2607.15774#S3.E2)\)⊳\\trianglerightdetails in Section[3\.1](https://arxiv.org/html/2607.15774#S3.SS1)
6:
fravg=fr\_\{avg\}=aggr\_avg\(
A\)\{A\}\);
frabs=fr\_\{abs\}=aggr\_abs\(
A\)\{A\}\)⊳\\trianglerightdetails in Section[3\.2](https://arxiv.org/html/2607.15774#S3.SS2)
7:
Fsel\_avg=elbow\_cut\(fravg\)F\_\{sel\\\_avg\}=elbow\\\_cut\(fr\_\{avg\}\);
Fsel\_abs=elbow\_cut\(frabs\)F\_\{sel\\\_abs\}=elbow\\\_cut\(fr\_\{abs\}\)⊳\\trianglerightdetails in Section[3\.3](https://arxiv.org/html/2607.15774#S3.SS3)
8:
Fsel=Fsel\_abs∩Fsel\_avgF\_\{sel\}=F\_\{sel\\\_abs\}\\cap F\_\{sel\\\_avg\}
9:return
FselF\_\{sel\}
Our methodology \(Algorithm[1](https://arxiv.org/html/2607.15774#alg1)\) relies on the explanation setDexpD\_\{exp\}, which is a subset of the training set \(assuring there is no information leakage\), composed by randomly samplingnsampn\_\{samp\}per class, the explanation classifierclfclfi\.e\., the model which is explained \(in this work Hydra\) using the explainerexpexp\. The key functions are:
- •Theaggr\_avgandaggr\_absfunctions, which aggregate the attribution values of different samples based on two complementary strategies\.
- •Elbow cutwhich selects the topKKfeaturesFselF\_\{sel\}\.
### 3\.1Computing Feature Attributions
After trainingclfclfusing the training setDDand instantiating the explanation setDexpD\_\{exp\}, the result of applying the explainerexpexpto the classifierclfclfand the explanation setDexpD\_\{exp\}are thelocal attributions𝒜∈ℛn×d×L\\mathcal\{A\}\\in\\mathcal\{R\}^\{n\\times d\\times L\}wheren=\|Dexp\|n=\|D\_\{exp\}\|\. The next step is to calculate thefeature attributionof the feature setFFfor each time series inDexpD\_\{exp\}\. The attribution of a feature is simply the average attribution of all data points represented by the feature\. In particular, if features represent channels \(for channel selection\), the attribution of a feature is:
Ai,j=1L∑t=1L𝒜i,j,t\{A\}\_\{i,j\}=\\frac\{1\}\{L\}\\sum\_\{t=1\}^\{L\}\\mathcal\{A\}\_\{i,j,t\}\(1\)
whereAi,j\{A\}\_\{i,j\}is the attribution of channeljj\(or featureFjF\_\{j\}\) in time seriesDiD\_\{i\}\. This is the row aggregation step in Figure[1](https://arxiv.org/html/2607.15774#S3.F1)\.
Similarly, if each feature represents a time point \(for time point selection\), the feature attribution is:
Ai,t=1d∑j=1d𝒜i,j,t\{A\}\_\{i,t\}=\\frac\{1\}\{d\}\\sum\_\{j=1\}^\{d\}\\mathcal\{A\}\_\{i,j,t\}\(2\)
whereAi,t\{A\}\_\{i,t\}is the attribution of time pointtt\(or featureFtF\_\{t\}\) in time seriesDiD\_\{i\}\. Stacking the attributions for each feature and each sample, we obtain the matrixAA\. To be noted that the next steps are executed regardless of the selection type \(channel or time points\)\.
Figure 1:drXAI: Channel selection for MTSC using XAI scores computed from time series attributions\.#### Attribution Background Set\.
As mentioned in Section[2\.3](https://arxiv.org/html/2607.15774#S2.SS3), both explainers require abackground dataset\. Since the computational complexity of explaining linearly increases with the cardinality of this set, we study two different single\-sample backgroundsbb\.
Zeros background \(Zeros\)\.A default choice for most explanation frameworks, i\.e\., a time series full of zeros\. Although this is conceptually very simple, it is an unrealistic sample, potentially leading to unreasonable explanations\. Mathematically, this is defined as:
b=𝟎d×Lb=\\mathbf\{0\}\_\{d\\times L\}
Class prototypes average \(Proto\)\.The background we propose uses the prototype of each classcc:
pc=1\|Dc\|∑Di∈DcDip\_\{c\}=\\frac\{1\}\{\|D^\{c\}\|\}\\sum\_\{D\_\{i\}\\in D^\{c\}\}D\_\{i\}\(3\)
whereDc⊂DD^\{c\}\\subset Dis the set of all samples in the training set, belonging to classcc\. LetCCbe the set of all classes\. The proto background is defined as the average of class prototypes:
b=1\|C\|∑c∈Cpcb=\\frac\{1\}\{\|C\|\}\\sum\_\{c\\in C\}p\_\{c\}\(4\)
### 3\.2Aggregating Feature Attribution over Samples
The previous step computes the sample\-wise attributions for each feature in the feature set F\. The next step is to aggregate these local attributions over the explanation setDexpD\_\{exp\}to obtainglobal attributions\. This results in the feature importance scores𝐟𝐫𝐚𝐯𝐠,𝐟𝐫𝐚𝐛𝐬∈ℛ\+m\\mathbf\{fr\_\{avg\}\},\\mathbf\{fr\_\{abs\}\}\\in\\mathcal\{R\}^\{m\}\_\{\+\}, which can be used for feature selection \(e\.g\., this is the channel scores vector in Figure[1](https://arxiv.org/html/2607.15774#S3.F1)\)\. We use two complementary approaches for this aggregation which proved effective in our experiments\.
aggr\_avg: In this scenario, the feature importance score is averaged over all samples first, then the absolute value is computed\. This strategy aims to de\-emphasize uncertain features, i\.e\., features that have mixed negative and positive attribution signs \(thus roles\) across the dataset\.
fravg=\|1n∑i=1nAi\|fr\_\{avg\}=\|\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}A\_\{i\}\|\(5\)
whereAiA\_\{i\}is theii\-th a row ofAA, i\.e\., attribution vector of the sampleDiD\_\{i\}\. aggr\_abs: On the other hand, this strategy averages the absolute value of the attributions for each feature:
frabs=1n∑i=1n\|Ai\|fr\_\{abs\}=\\frac\{1\}\{n\}\\sum\_\{i=1\}^\{n\}\|A\_\{i\}\|\(6\)
This strategy simply detects the mostactivefeatures, regardless of the sign\. The dimension of these vectors ism=dm=dfor channel selection andm=Lm=Lfor time point selection\.
### 3\.3Feature Selection using Elbow Cut
Theelbow cutof a curve is a common heuristic to choose a point where intuitively the diminishing returns are no longer worth the additional cost; e\.g\., it is often used to select the number of clusters while runningk\-meansalgorithms, and in the channel selection context for the ECP and ECS methods as described in\[dhariyal2023scalable\]\.
In drXAI, theelbow cutis used after all features are sorted by their computed score, to automatically select the number of top features to retain:Fsel\_absF\_\{sel\\\_abs\}andFsel\_avgF\_\{sel\\\_avg\}are respectively the results of the elbow cut applications onfrabsfr\_\{abs\}andfravgfr\_\{avg\}\. The set of final selected featuresFselF\_\{sel\}is the intersection offrabsfr\_\{abs\}andfravgfr\_\{avg\}\(Line 7 Algorithm[1](https://arxiv.org/html/2607.15774#alg1)\)\. Intuitively, this set contains only features that are both magnitude\- and sign\-wise important, thereby including only the essential ones\.
### 3\.4Time and Space Complexity for drXAI
The computational efficiency of thedrXAIframework is a primary contribution, specifically designed to mitigate the prohibitive costs of training classifiers on high\-dimensional time series\. The total complexity of the pipeline is the sum of three distinct phases: \(i\) Explainer Classifier Training, \(ii\) Attribution Generation, and \(iii\) Feature Selection\.
Explainer Classifier Training\.We useHydraas the core classifier for its linear\-scaling properties\. For a datasetD\(n,d,L\)D\(n,d,L\), Hydra extracts features usingkkrandom convolutional kernels Sincekkis a fixed hyperparameter, this phase remainsO\(n⋅d⋅L\)O\(n\\cdot d\\cdot L\), which is asymptotically optimal for time series processing\.
Attribution Generation\.The complexity of this phase is the product of the number of samples to be explained and the cost of the chosen explainer:
- •Feature Ablation \(FA\):For each sample, FA requires a forward pass for each feature\. For channel selection, this isO\(d⋅CostHydra\)O\(d\\cdot\\text\{Cost\}\_\{\\text\{Hydra\}\}\), and for time\-point selection,O\(L⋅CostHydra\)O\(L\\cdot\\text\{Cost\}\_\{\\text\{Hydra\}\}\)\.
- •SHAP:SHAP estimates values via sampling\. While the number of samplesssscales with the feature space, Hydra’s GPU\-accelerated inference, coupled with TS segmentation, allows SHAP to remain tractable even forL\>1,000L\>1,000\.
Feature Selection\.This is a step that has a constant time involving sorting the features by importance and applying the elbow cut\.
Space Complexity\.The memory footprint is dominated by the storage of attribution mapsO\(Dexp⋅d⋅L\)O\(D\_\{exp\}\\cdot d\\cdot L\)\. However, the subsequentelbow\-cutselection enables a significant reduction in the memory required for training deep models\. As demonstrated in our results \(Section[4](https://arxiv.org/html/2607.15774#S4)\), this reduction is the critical factor enablingConvTranto run on datasets where it would otherwise trigger Out\-of\-Memory \(OOM\) errors\.
## 4Experiments
In our experiments, we consider 4 configurations of our methods: the combinations of previously listed explainers and backgrounds, SHAP Proto, FA Proto, SHAP zeros, and FA zeros\. We hypothesize that the informative Proto background gives a small boost to our method compared to the uninformative zeros\. We also hypothesize that, because SHAP is a more complex algorithm, it yields better selection than FA\. To assess the quality of the selected features, the following pipeline is applied to each SOTA classifier described in Section[2\.2](https://arxiv.org/html/2607.15774#S2.SS2), and each dataset described in Sections[4\.2](https://arxiv.org/html/2607.15774#S4.SS2)and[4\.3](https://arxiv.org/html/2607.15774#S4.SS3)\.
- •Hydra is trained on the current dataset\. This allows the application of the drXAI algorithm in the 4 configurations previously listed \(e\.g\., drXAI\-SHAP\-Proto\)\. Specifically, for each of those, we get the selected featuresFselF\_\{sel\}\.
- •Each baseline, along with a random selection method, is evaluated on the dataset to obtain itsFselF\_\{sel\}\.
- •For each of theFselF\_\{sel\}, we trained each SOTA classifier 3 times using the reduced datasetDFselD\_\{F\_\{sel\}\}, recording the mean accuracy and the mean time for training plus inference\. Multiple training rounds \(3\) were done to account for the stability of the trained classifiers\.
- •Our evaluation of each selection is based on mean accuracy over the 3 runs, and on the percentage of saved data\.
Experiments were conducted using a machine with AMD EPYC 9654P CPU \(96 cores, 192 threads\), NVIDIA GeForce RTX 4090 GPU \(24GB VRAM\), and 1\.5Tb of RAM\. Considering the breadth of experiments, the main article reports only the most salient results, while the Appendix provides more details\.
### 4\.1Classifier Training
For MRH, we implemented our version based on MultiRocket and Hydra transformations from the*aeon*library\[aeon24jmlr\]and the RidgeCV Classifier in*sklearn*\[scikit\-learn\]\. For Hydra, we used the default hyperparameters, setting the batch size to 256\. For ConvTran and InceptionTime training, we used the strategy of\[dempster2025monstermonashscalabletime\], i\.e\., reserving 10% of the training set as a validation set\. We allow up to 100 epochs with early stopping, using the validation loss as criterion\. We set the batch size to 256\.
Finally, for computationally demanding UTSC datasets, we make two adjustments: we reduce the batch size for InceptionTime and ConvTran to fit the GPU memory and switch to an iterative solver for the Ridge Classifier in MultiRocket\-Hydra, which is required when its input matrix exceeds a maximum size\.
### 4\.2Channel Selection for MTSC Datasets
The MTSC datasets have fewer samples than the UTSC ones \(Appendix\)\. Thus, we setnsampn\_\{samp\}, the number of sampled instances per class composingDexpD\_\{exp\}, to 50\. We also set the maximum non\-improving epochs before early stopping for ConvTran and InceptionTime to 20\. drXAI is compared against three recent baselines, ECP, ECS, and TSelect, as well as a random selection baseline that samples both the number of channels to retain and the channels to keep from a uniform distribution\.
#### 4\.2\.1Synthetic Dataset\.
Table 1:Number of informative/uninformative channels selected for synthetic MTSC data and mean accuracy \(across 3 runs of SOTA classifiers\)\.For the MTSC synthetic dataset, we used the data generator code from\[serramazza2024improving\]\. Each channel is composed of a lower frequencysine wave\. For each sample, two higher\-frequencysupport waves, shorter than the previous ones and with frequencies varying within a specific range, are injected into two randomly selected informative channels\. The binary classification task is whether the sum of these two frequencies exceeds a threshold\. We generate 5,000 samples for each of the train and validation sets\. The series length is set to 1,000 time points; there are 20 informative and 20 uninformative channels \(40 total\)\. Using this controlled dataset, we can evaluate how many of the first 20 informative and the last 20 uninformative channels are selected: the ideal selection is all of the informative, none of the uninformative channels\. Table[1](https://arxiv.org/html/2607.15774#S4.T1)shows that only our methodexclusively selects informative channels; using the Proto baseline, FA selects 19 out of 20 channels, and SHAP selects 9\. This results in these two selections achieving the top two accuracies\. Specifically, the drXAI\-FA\-Proto configuration outperforms the best baseline \(ECP\) by 10 percentage points in mean accuracy\.
#### 4\.2\.2Real\-world Data\.
For real\-world datasets, we focus on those with a large number of channels and time points, where the benefits of feature selection are more pronounced\. In order to test drXAI on large\-scale MTSC datasets, we selected Face Detection\[olivetti2014meg\]\(144 channels, 62 time points\), Arc Loss\[arc\_loss\]\(96 channels, 1101 time points\), Military Press and Rowing \(mean\-centered datasets, 50 channels and 161 time points each\)\[ashishecml23\]\. We summarize the findings usingMulti Comparison Matrices\(MCM\)\[ismail2023approach\]for mean accuracy and for percentage of data saved, respectively, in Figure[2](https://arxiv.org/html/2607.15774#S4.F2)and[3](https://arxiv.org/html/2607.15774#S4.F3)\.
Figure 2:Mean accuracy of each selection \(and All Features\) for the 4 MTSC real\-world datasets and the 3 SOTA classifiers, yielding 12 results in total\.Figure[2](https://arxiv.org/html/2607.15774#S4.F2)highlights that channel reduction is an important task, as 3 configurations of our method and 2 baselines have a higher average accuracy than using all features in the dataset\. Our most accurate configuration, drXAI\-SHAP\-Proto, stands between the best 2 baselines accuracies, i\.e\., ECP and ECS\. Using the faster FA explainer, our proposed background, Proto, is worse than the zero background, mainly due to poor performance when coupled with the MP dataset \(see Appendix\), although it is better than both ECP and ECS on 3 out of 12 experiments\. TSelect has the lowest accuracy among the compared methods\. Analyzing the percentage of saved data \(i\.e\., how many channels are discarded\), Figure[3](https://arxiv.org/html/2607.15774#S4.F3)shows thateach configuration of our method considerably saves more datathan ECP and ECS, with at least80%80\\%reduction\. In this regard, the zero\-background achieves a better reduction than Proto\. Globally,our method is the best trade\-off between accuracy and data saved, as different configurations achieve very good performance in both aspects, while ECP and ECS excel only in accuracy and TSelect in data reduction\.
Figure 3:Mean percentage of data saved by each selection for the 4 MTSC datasets\.
### 4\.3Time Point Selection on UTSC Datasets
Since UTSC datasets have more samples than the MTSC ones \(see Appendix\), we empirically setnsampn\_\{samp\}to max 100 samples per class, rather than 50\. We also decrease the number of non\-improving epochs before early stopping to 10\. Lastly, since defining each time point as a feature inFselF\_\{sel\}would be extremely expensive for computing attribution, we instead group them in 20 consecutive, equal\-length windows as done in\[serramazza2024improving\]\. This means that all time points within a window are either all selected or all discarded\.
The baselines considered in this section are: the filter method Mutual Information \(MI\)\[scikit\-learn\], the wrapper method Random Forest feature importance \(RFI\), and random selection\. Similar to the channel selection procedure, random selection samples both the number and the specific time points from a uniform distribution\. Other possible baselines, such as recursive feature elimination, are not considered due to their high computational cost, especially for datasets with long time series\.
#### 4\.3\.1Synthetic Dataset\.
drXAI\-FAProtodrXAI\-SHAPProtodrXAI\-FAzerosdrXAI\-SHAPzerosRFIMIrandomn\. informative 10k9,00010,00060003000325217676,000n\. uninformative 10k0000002,000mean accuracy\.8500\.882\.801\.608\.694\.7490\.627
Table 2:Number of informative and uninformative time points for synthetic UTSC data and relative mean accuracy of compared feature selection methods \(across the 3 runs of each of the 3 SOTA classifiers\)\.For the UTSC synthetic data, we used the data generator code included in\[nguyen2025tshap\], mirroring the MTSC case, but withd=1d=1channels\. Two support waves, injected in random places within the first 10,000informativetime points, define the same binary task as in the MTSC case\. This informative area is followed by another 10,000uninformativepoints\. In this case, since using such a long series has a severe consequence on the running times of models, we used only 1,000 samples for training, and kept 5,000 for the test set\. As in the former MTSC case, ideally, the first half of the features is selected, while the remaining second is discarded\.
Table[2](https://arxiv.org/html/2607.15774#S4.T2)shows that each evaluated method only selects from relevant time points\. Among our configurations,drXAI\-SHAP\-Proto has a perfect selection, selecting all 10,000 important features; drXAI\-FA\-Proto selected 9,000\. Among the remaining methods, only drXAI\-FA\-Zeros, selecting 6,000 features, achieves a good accuracy, since the baselines RFI and MI, as well as SHAP\-Zero, select at most 3,252 features, retaining insufficient signal for accurate classification\. ConvTran cannot be trained using all features due to exceeding the GPU VRAM available\. Nevertheless, it can run on reduced data of each selection: using drXAI\-SHAP\-Proto, it achieves a 0\.921 average accuracy \(Appendix\)\.
#### 4\.3\.2Real\-world Data\.
Figure 4:Mean accuracy of each selection \(and All Features\) for the 5 UTSC datasets used and the 3 classifiers, yielding 15 results in total\.For real\-world datasets, we used large\-scale datasets Cornell Whale Challenge, Mosquitos Sound and Whale Sounds from the MONSTER benchmark\[dempster2025monstermonashscalabletime\], Right Whale Calls\[cox2006understanding\]and Urban Sound\[salamon2014dataset\]\. These datasets were chosen due to the number of time points \(2\.5\-44k length\) and samples \(2\.7\-84k\)\. We note that using the Urban Sound dataset, which has 44k time points, ConvTran can be trained only using the reduced data after feature selection, as it otherwise exceeds the GPU memory limit\. Figure[4](https://arxiv.org/html/2607.15774#S4.F4)and[5](https://arxiv.org/html/2607.15774#S4.F5)show, respectively, the MCM for accuracy across all datasets and classifiers and the MCM for percentages of data saved of each selection\. In this case,all configurations of our method achieve higher mean accuracy compared to the baselines\. The most accurate configuration is drXAI\-FA\-Proto, having accuracy comparable to the original datasets using all features\. Configurations using the informative Proto background have a big margin over those using zeros\. Comparing the baselines, MI outperforms RFI\. Focusing on data saved, RFI has the largest average save, followed by our method, and lastly MI\. Among our configurations, the more expensive and accurate SHAP can save more data than the FA, and for both explainers, the Proto background saves more data than the zero background\. We note that our configurations, excluding FA Zeros, save at least80%80\\%of the data\. As with MTSC, drXAI is the only method achieving a good trade\-off between accuracy and data reduction\. RFI reduces data aggressively but at the cost of the worst accuracy, while MI shows no clear advantage in either aspect\.
Figure 5:Mean percentage of data saved of each selection for the 5 UTSC datasets\.
### 4\.4Accuracy\-Time Trade\-off Analysis
An aspect worth analyzing is the total time required by drXAI compared to directly training the model using the original data\. In our method, in addition to the cost of training the SOTA classifiers using the reduced data, the time to train Hydra and to compute the explanation \(and thus the selection\) must be considered\. Figure[6](https://arxiv.org/html/2607.15774#S4.F6)shows the accuracy vs total training time of 2 drXAI configurations vsAll Features\(training on non\-reduced data\) for ConvTran \(the most expensive classifier\), on 4 of the UTSC datasets, where the model can run usingAll Features\. The plots show that the accuracy is comparable, while the total time is reduced by one order of magnitude\. The Appendix shows a detailed analysis of this cost\.
Overall, based on our experiments, SHAP is preferable when aggressive data reduction is the priority, while FA is the best choice under time constraints, offering a faster yet effective selection\.




Figure 6:Accuracy vs Time \(minutes in log scale\) for ConvTran on UTSC datasets\. Total time compares training on All Features vs drXAI pipeline \(Hydra training \+ explanation \+ training on reduced data\)\. On 2 of 6 datasets, All Features cannot run due to exceeding GPU memory\.
## 5Conclusion
This paper introduces drXAI, a novel methodology that repurposes XAI attribution methods to drive effective data reduction in TSC\. By leveraging the GPU\-accelerated Hydra classifier and fast explainers, we successfully bridge the gap between XAI interpretability and practical model scalability\. Our framework leverages two complementary aggregation strategies \(absolute and average\), identifying the most salient features using an automated elbow\-cut heuristic, avoiding the need for manual thresholds\.
We validated drXAI across large\-scale synthetic and real\-world benchmarks using three SOTA classifiers: MultiRocket\-Hydra, InceptionTime, and ConvTran\. Our results demonstrate that drXAI consistently achieves over 80\-90% data reduction while maintaining, and in some cases exceeding, classification accuracy on the full dataset\. Specifically, drXAI\-SHAP\-Proto emerged as the most accurate configuration for channel selection in MTSC, while drXAI\-FA\-Proto led in performance for time\-point selection in UTSC\. The proposed Proto background marginally outperforms the zero background, at no additional cost; SHAP achieves superior data reduction compared to Feature Ablation but at the expense of longer computation time\.
Crucially, we demonstrate that data reduction enabled by the lightweight Hydra model allows resource\-intensive architectures like ConvTran to scale to massive datasets that were previously inaccessible due to GPU memory constraints\. While limitations exist regarding the computational overhead of SHAP on extremely long sequences, by grouping features drXAI shows that XAI can be a robust, flexible tool for high\-performance feature selection\. Future work will extend this framework to regression tasks and explore the simultaneous reduction of both channels and time points\.
## ReferencesSimilar Articles
Oxlo.ai
Oxlo.ai enables scaling across AI models while controlling costs.
@AlphaSignalAI: https://x.com/AlphaSignalAI/status/2062553418460479577
An open-source tool called Headroom compresses AI agent context by up to 90% using a reversible Compress-Cache-Retrieve architecture, enabling models to retrieve original details on demand instead of discarding them permanently.
A comprehensive method to brutally reduce your Agentic AI token cost by at least 95%, aka a summary of current token reduction method
This article presents a comprehensive guide to reduce token costs in Agentic AI systems by 95%, detailing seven core techniques including tree-structured document architecture, AI auto-compression, local model management, and script-to-API calls.
I built an open-source tool that reduces TensorBoard trace sizes by 90%+ for JAX/XLA (XProf Cubism Reducer)
An open-source tool called XProf Cubism Reducer reduces TensorBoard trace sizes by over 90% for JAX/XLA, making performance profiling more efficient.
@alesfav: AI needs vastly more data than we do. One idea might close the gap: don't predict raw signals (tokens), predict your ow…
This thread presents a theoretical result showing that predicting abstract latent representations (as in JEPA and data2vec) instead of raw tokens can exponentially reduce the data gap between AI and human learning.