Spectral Aliasing Pretext: A novel task for Self-Supervised fault diagnosis in rotating machinery

arXiv cs.LG Papers

Summary

This paper introduces Spectral Aliasing Pretext (SAP), a self-supervised learning method for fault diagnosis in rotating machinery. By deliberately undersampling vibration signals and training a Transformer to reconstruct the original spectrum, SAP learns discriminative frequency-domain representations that achieve strong classification performance with limited labeled data.

arXiv:2608.05705v1 Announce Type: new Abstract: Deep learning is a new way for machinery fault diagnosis but requires extensive labeled data, a scarce resource in industrial settings. We propose Spectral Aliasing Pretext (SAP), a self-supervised learning method that pretrains models on unlabeled vibration data by exploiting spectral aliasing. We deliberately undersample signals to create folded spectrum, then train a Transformer to reconstruct the original unfolded spectrum. This pretext task forces the model to learn frequency-domain invariants characteristic of mechanical faults, without potentially destructive augmentations. Experiments on the CWRU dataset show that SAP learns stable and highly discriminative representations. In a linear probing setting, SAP quickly achieves very high classification performance with only a small fraction of labeled data and low variance. In contrast, full fine-tuning, including fully supervised training, does not lead to more stable or better results. Overall, these findings suggest that SAP combined with linear probing can be more effective and reliable than fully supervised training for fault diagnosis with limited labeled data.
Original Article
View Cached Full Text

Cached at: 08/07/26, 07:51 AM

# Spectral Aliasing Pretext: A novel task for Self-Supervised fault diagnosis in rotating machinery
Source: [https://arxiv.org/html/2608.05705](https://arxiv.org/html/2608.05705)
###### Abstract

Deep learning is a new way for machinery fault diagnosis but requires extensive labeled data, a scarce resource in industrial settings\. We propose Spectral Aliasing Pretext \(SAP\), a self\-supervised learning method that pretrains models on unlabeled vibration data by exploiting spectral aliasing\. We deliberately undersample signals to create folded spectrum, then train a Transformer to reconstruct the original unfolded spectrum\. This pretext task forces the model to learn frequency\-domain invariants characteristic of mechanical faults, without potentially destructive augmentations\. Experiments on the CWRU dataset show that SAP learns stable and highly discriminative representations\. In a linear probing setting, SAP quickly achieves very high classification performance with only a small fraction of labeled data and low variance\. In contrast, full fine\-tuning, including fully supervised training, does not lead to more stable or better results\. Overall, these findings suggest that SAP combined with linear probing can be more effective and reliable than fully supervised training for fault diagnosis with limited labeled data\.

## IIntroduction

![Refer to caption](https://arxiv.org/html/2608.05705v1/figure/SAP.png)Figure 1:Spectral Aliasing Pretext \(SAP\) pretraining: from aliased spectrum generation to reconstruction\.fsf\_\{s\}the original sample frequency,fs′f\_\{s\}^\{\\prime\}the corrupted sample frequencyDeep learning has transformed machinery fault diagnosis, achieving remarkable accuracy when large labeled datasets are available\[[13](https://arxiv.org/html/2608.05705#bib.bib16)\]\. However, in operational technology \(OT\) environments, collecting comprehensive labeled fault data is a major practical limitation\[[9](https://arxiv.org/html/2608.05705#bib.bib17)\]\. Acquiring vibration signals under diverse fault conditions requires costly test benches, controlled degradation protocols, and expert identification\[[11](https://arxiv.org/html/2608.05705#bib.bib18)\]resources rarely available in industrial settings\. This data scarcity creates a fundamental bottleneck for deploying deep learning in real\-world predictive maintenance\.

Self\-supervised learning \(SSL\) offers a promising paradigm to address this challenge\[[2](https://arxiv.org/html/2608.05705#bib.bib2)\]\. Instead of requiring expensive labels upfront, SSL methods first pretrain models on abundant unlabeled data using pretext tasks automatically learning without human supervision\. For time series analysis, several SSL approaches have emerged in recent years\. Contrastive methods like TS2Vec\[[15](https://arxiv.org/html/2608.05705#bib.bib1)\]and TS\-TCC\[[5](https://arxiv.org/html/2608.05705#bib.bib11)\]learn representations by maximizing agreement between augmented views of the same signal, drawing inspiration from successful computer vision frameworks like SimCLR\[[3](https://arxiv.org/html/2608.05705#bib.bib3)\]\. Generative methods employ masked reconstruction strategies, predicting missing portions of the input similar to BERT’s\[[4](https://arxiv.org/html/2608.05705#bib.bib12)\]approach in natural language processing, or Masked Autoencoders \(MAE\)\[[7](https://arxiv.org/html/2608.05705#bib.bib21)\]in computer vision\. While Masked Image Modeling \(MIM\)\[[8](https://arxiv.org/html/2608.05705#bib.bib22)\]works well for images due to strong spatial redundancy, its relevance for vibration time series used in fault classification is less clear\. In frequency\-domain signals, diagnostic information is often concentrated in specific harmonics and in the global relationships between frequency components\. Random masking may remove or keep these components without control, allowing the model to reconstruct the signal using local correlations without necessarily learning the physical structure of fault signatures\. Although these methods have shown promising results for general time\-series representation learning and have started to be explored for machinery fault diagnosis\[[12](https://arxiv.org/html/2608.05705#bib.bib19)\]\. They do not explicitly exploit the deterministic spectral organization produced by mechanical faults\.

Recent work on semi\-supervised and transfer learning for bearing diagnosis\[[6](https://arxiv.org/html/2608.05705#bib.bib5)\]has made progress in reducing labeled data requirements, but these approaches still do not exploit frequency\-domain physics as a core learning principle\. However, current SSL methods face a critical limitation when applied to vibration\-based fault diagnosis\. Most approaches operate primarily in the time domain and rely heavily on data augmentation strategies adding noise, scaling amplitudes, temporal cropping, or applying random transformations\[[16](https://arxiv.org/html/2608.05705#bib.bib4)\]\. Furthermore, existing methods do not explicitly leverage the rich physical structure inherent to the frequency domain, where mechanical faults manifest as deterministic, mathematically predictable patterns\.

We argue that for vibration analysis, working directly with frequency\-domain representations offers distinct advantages\. Mechanical faults generate vibrations at characteristic frequencies determined by geometry and kinematics: a bearing defect produces periodic impacts whose frequencies depend on the bearing dimensions, number of rolling elements, and shaft speed\. These deterministic signatures are most clearly visible in the magnitude spectrum\. Moreover, the measured vibration signal exhibits a dual nature a superposition of cyclostationary components \(periodic patterns with deterministic frequencies associated with faults\) and stochastic modulation effects \(structural resonances and propagation paths that vary randomly\)\. The Fourier transform naturally separates these components, projecting the signal into a space where fault\-related features are compact and discriminant\[[1](https://arxiv.org/html/2608.05705#bib.bib14)\]\.

Analyzing these frequency patterns requires capturing long\-range dependencies across the spectrum\. Fault signatures often appear as low\-frequency fundamental peaks followed by high\-frequency modulation sidebands distributed across wide frequency bands\. Traditional convolutional neural networks \(CNNs\), which have shown success in supervised vibration\-based fault diagnosis\[[10](https://arxiv.org/html/2608.05705#bib.bib13)\], are designed to exploit local spatial patterns and struggle with these distributed relationships\. The Transformer architecture, with its global self\-attention mechanism, naturally models dependencies between frequency components\. Recent work has demonstrated the effectiveness of Transformers for time series classification\[[14](https://arxiv.org/html/2608.05705#bib.bib20)\]and has begun to explore their application to vibration\-based condition monitoring though primarily in supervised settings with abundant labeled data\.

We propose a SSL approach that addresses these limitations\. Our core contribution is Spectral Aliasing Pretext \(SAP\), a novel pretext task that operates directly on magnitude spectra and exploits a fundamental phenomenon in signal processing: spectral aliasing\. When a signal is undersampled, high\-frequency components fold back into the low\-frequency range following deterministic mathematical rules, creating an ambiguous but structured corruption\. We train a Transformer encoder\-decoder to reverse this folding to reconstruct the non\-aliased spectrum from an intentionally aliased version\. This task compels the model to learn deep physical constraints about spectral structure without relying on potentially destructive augmentations\. Existing SSL methods do not exploit aliasing in the amplitude spectrum as a pretext task, which represents a gap in leveraging frequency\-domain invariants for fault diagnosis\. Our main contributions are threefold:

1. 1\.We proposeSpectral Aliasing Pretext \(SAP\), a self\-supervised pretraining method based on spectral aliasing, a signal processing phenomenon for vibration data\.
2. 2\.We show that a Transformer trained on magnitude spectra with SAP learns effective representations, reaching near\-optimal fault classification performance on CWRU using only a small amount of labeled data\.

The remainder of this paper is organized as follows\. Section II describes the datasets and our proposed methodology, including the mathematical formulation of spectral aliasing and the Transformer architecture\. Section III details the experimental protocol for pretraining and downstream evaluation\. Section IV presents comprehensive results on classification performance, followed by discussion of the learned representations\. Section V concludes with perspectives on future research directions\.

## IIMateriel and Methods

### II\-ADatasets

We use the widely adopted Case Western Reserve University \(CWRU\) bearing dataset as a evaluation benchmark\. It contains vibration signals acquired under four bearing health conditions:normal,inner\-race fault,outer\-race fault, andball fault\. Fault diameters range from 0\.007 to 0\.028 inches, covering increasing levels of defect severity\. Signals were collected at several load levels from 0 to 3 horsepower \(motor speeds of 1797 to 1730 RPM\)\. We use only the Fan End accelerometer sampled at 12 kHz\. The dataset provides a controlled environment in which spectral structures, including characteristic fault harmonics are well established\.

### II\-BProposed Approach

#### II\-B1Problem Formulation

The problem of spectral un\-folding is fundamentally rooted in spectral aliasing, which occurs when a continuous time\-domain signal,x​\(t\)x\(t\), is sampled at a frequencyfsf\_\{s\}that is less than twice its maximum frequency component, thereby violating the Nyquist\-Shannon sampling theorem\. If the signal is undersampled, the new sampling frequencyfs′f^\{\\prime\}\_\{s\}is reduced\. Original frequency componentsf\>fs′/2f\>f^\{\\prime\}\_\{s\}/2are then folded back into the valid range\[0,fs′/2\]\[0,f^\{\\prime\}\_\{s\}/2\]\. Mathematically, the aliased spectrumX′​\(f\)X^\{\\prime\}\(f\)is represented as a superposition of the true spectrumX​\(f\)X\(f\)and its replicas shifted by multiples of the reduced sampling rate Eq\. \([1](https://arxiv.org/html/2608.05705#S2.E1)\)\.

X′​\(f\)=∑k=−∞∞X​\(f−k​fs′\)X^\{\\prime\}\(f\)=\\sum\_\{k=\-\\infty\}^\{\\infty\}X\(f\-kf^\{\\prime\}\_\{s\}\)\(1\)
When magnitude spectrum is estimated using the Fast Fourier Transform \(FFT\) on the undersampled signal, this summation manifests as folding, where high\-frequency information is superimposed onto low\-frequency information\. The theoretical challenge is to reverse this aliasing that is, to infer and reconstruct the uncorrupted frequency distribution, from the mathematically ambiguous folded spectrum\.

#### II\-B2Pretext Task

We construct a self\-supervised pretext task explicitly designed to capture the non\-linear relationship between aliased and non\-aliased spectral components\. The complete preprocessing and corruption pipeline involves six sequential steps: windowing, undersampling, mean centering, discret Fourier transform, symmetric input preparation and normalization\.

Window Slicing\.Raw time\-domain vibration signals are first segmented using a sliding window ofN=2048N=2048points with a stride of 256 points\. This produces overlapping temporal segmentsx​\(t\)∈ℝ2048x\(t\)\\in\\mathbb\{R\}^\{2048\}that capture local vibrational behavior\.

Undersampling\.To create the corrupted input for our pretext task, each raw segmentx​\(t\)x\(t\)is deliberately undersampled by a factor of two\. This produces a corrupted segmentx′​\(t\)∈ℝ1024x^\{\\prime\}\(t\)\\in\\mathbb\{R\}^\{1024\}\. By reducing the Nyquist frequency fromfs/2f\_\{s\}/2tofs/4f\_\{s\}/4, this undersampling causes spectral aliasing range according to the mathematical relationship described in Eq\. \([1](https://arxiv.org/html/2608.05705#S2.E1)\) \.

Mean Centering\.Both the original segmentx​\(t\)x\(t\)and the corrupted segmentx′​\(t\)x^\{\\prime\}\(t\)are mean\-centered to remove the continu component\. This ensures that the spectrum focuses on oscillatory components rather than constant offsets\.

Discret Fourier Transform\.We apply the real\-valued Fast Fourier Transform to both centered segments, transforming them from the time domain to the frequency domain\. Since the input signals are real\-valued, we exploit the Hermitian symmetry of the finite Discrete Fourier Transform \(DFT\) to compute only the non\-redundant positive\-frequency components\.

Symmetric Input Preparation\.The undersampled spectrumX′​\(f\)∈ℝN/4X^\{\\prime\}\(f\)\\in\\mathbb\{R\}^\{N/4\}has half the dimensionality of the target spectrumX​\(f\)∈ℝN/2X\(f\)\\in\\mathbb\{R\}^\{N/2\}, creating a dimensional mismatch for the Transformer encoder\-decoder architecture, which requires identical sequence lengths at input and output\. To restore the required dimensional consistency, we construct an extended inputX′′​\(f\)X^\{\\prime\\prime\}\(f\)by concatenatingX′​\(f\)X^\{\\prime\}\(f\)with its spatially reversed version\.

Normalization\.To stabilize training, magnitude spectra are log\-compressed and standardized using global statistics \(μX,σX\\mu\_\{X\},\\sigma\_\{X\}\) from the pretraining dataset:

Xi​\(f\)norm=l​o​g​\(1\+Xi​\(f\)\)−μXσX,i∈\{0,…,n−1\}X\_\{i\}\(f\)\_\{\\text\{norm\}\}=\\frac\{log\(1\+X\_\{i\}\(f\)\)\-\\mu\_\{X\}\}\{\\sigma\_\{X\}\},\\quad i\\in\\\{0,\\ldots,n\-1\\\}\(2\)
Unlike per\-sample scaling, using global statistics ensures consistent input distributions and improves robustness to amplitude variations across operating conditions\. Preprocessed dataset statistics are summarized in Table[I](https://arxiv.org/html/2608.05705#S2.T1)\.

TABLE I:Dataset statistics after preprocessing\. No Sample refers to the number of normalized magnitude spectrum\.![Refer to caption](https://arxiv.org/html/2608.05705v1/x1.png)Figure 2:Macro F1\-score as a function of the training data ratio for \(a\) linear probing and \(b\) full fine\-tuning on CWRU\. Results are reported for random initialization, SAP pre\-training, and MAE pre\-training\. The masking ratio for MAE is 40%\.
#### II\-B3Model architecture

The model architecture \(Fig\.[1](https://arxiv.org/html/2608.05705#S1.F1)\) is based on a symmetric Transformer encoder\-decoder structure\. The input spectrum is tokenized into patches of sizePP\. The token is projected in embedding dimension fixed atdm​o​d​e​ld\_\{model\}\. Both the encoder and decoder consist ofLLidentical layers, and each layer employs multi\-head self\-attention withHHheads\. A learnable class token and Sinusoidal Positional Embeddings are used to maintain sequence integrity\. The entire structure is regularized using a dropout rate ofρd​r​o​p\\rho\_\{drop\}\. For the downstream classification task, the class token from the encoder \(the backbone\) is passed to a linear head classifier\.

TABLE II:Transformer encoder\-decoder hyperparameters

## IIIExperiments

### III\-ADataset Split Strategy

Two distinct data splitting strategies are employed depending on the learning stage\. For the self\-supervised pre\-training, the CWRU dataset is split using a heterogeneous strategy, where all available spectra are randomly partitioned into training and validation sets\. A seed is used to ensure reproducibility across all experiments\. We acknowledge that the random partition used during self\-supervised pre\-training may introduce overlap between training and validation spectra due to the sliding\-window procedure\. However, the downstream test sets are built from operating conditions strictly excluded from training \(unseen speed or speed\-load combinations\), ensuring an independent evaluation protocol and preventing leakage between training and test domains\. For the downstream supervised tasks, the data are split according to the operating speeds\. For all experiments, the backbone is pre\-trained on CWRU and specialized on CWRU using training data collected at 1750, 1772, and 1797 rpm, while evaluation is performed at 1730 rpm\.

### III\-BPre\-training Setup

Self\-supervised pre\-training is performed exclusively on the CWRU dataset\. Two pre\-training strategies are considered: the proposed SAP approach and a Masked Autoencoder \(MAE\)\[[7](https://arxiv.org/html/2608.05705#bib.bib21)\]used as a baseline for comparison\. The model is trained to minimize the mean squared reconstruction error \(MSE\)\. This choice reflects industrial scenarios where operating conditions may be unknown, and highlights the ability of self\-supervised learning to learn robust condition representations\.

### III\-CDownstream Setup

The downstream task consists of supervised fault classification and is evaluated on both the CWRU dataset\. The Transformer encoder learned during the pre\-training stage is used as a feature extraction backbone\. To assess label efficiency, we use different ratio of the downstream training set is used for supervised learning\. Two training regimes are considered for evaluate the models :

Linear probing: the backbone is initialized with self\-supervised pre\-trained weights and kept frozen, while a linear classification head is trained on top of the extracted features\.

Full fine\-tuning: the backbone is initialized with self\-supervised pre\-trained weights and jointly optimized with the linear classification head\.

We compare against a supervised baseline where the backbone is randomly initialized and trained on the available labeled data\. Performance is evaluated using the F1\-score on the held\-out operating condition, ensuring a fair comparison between self\-supervised and supervised methods under limited data and domain shifts\.

## IVResults and Discussion

TABLE III:Effect of Mask Ratio on Linear Probing and Full Fine\-tuning Performance \(%\)We evaluate the proposed Spectral Aliasing Pretext \(SAP\) on downstream fault classification under varying proportions of labeled data\. Performance is reported using the macro F1\-score on a held\-out operating condition\.

In the linear probing setting \(Fig\.[2](https://arxiv.org/html/2608.05705#S2.F2)\), SAP consistently outperforms MAE pretraining across all training data ratios\. SAP rapidly converges and reaches a macro F1\-score close to 1\.0 with only20%20\\%of the training set while maintaining very low variance across runs\. Since the backbone is frozen in this setting, these results directly reflect the intrinsic quality of the learned representations\. The strong performance combined with low variance suggests that SAP learns features that are both highly discriminative and well structured in feature space\. In other words, samples from different fault classes become linearly separable with minimal supervision\.

This behavior contrasts with MAE pretraining, which shows lower performance and higher variability\. The effectiveness of the MAE baseline is also notably sensitive to its masking hyperparameter \(Table[III](https://arxiv.org/html/2608.05705#S4.T3)\.\), the macro F1\-score for both linear probing and full fine\-tuning reaches its peak at a mask ratio of40%40\\%\. Masking\-based reconstruction mainly encourages the model to learn local correlations between frequency bins, but does not explicitly enforce the learning of global spectral relationships\. As a result, the learned features remain less structured and require additional supervised adaptation to become discriminative\. The stability of SAP in linear probing indicates that the pretext task itself provides a strong inductive bias: reconstructing an aliased spectrum requires modeling global relationships and dependencies across frequencies\. These constraints appear to guide the model toward a representation space that is already aligned with fault classes before any supervised training\.

In the full fine\-tuning setting \(Fig\.[2](https://arxiv.org/html/2608.05705#S2.F2)\), all methods, random initialization \(full supervised\), MAE pretraining, and SAP pretraining reach similar average performance, without significant differences\. However, the optimization process is less stable, with higher variance across runs\. Surprisingly, even fully supervised training from random initialization does not consistently converge toward stable results, and fine\-tuning tends to increase performance variability\. This may be explained by the large number of parameters updated during fine\-tuning, which makes optimization more sensitive to initialization and sampling effects\. It may also reflect the relative simplicity of the CWRU dataset\. Many models can eventually fit the data, but the optimization trajectory remains unstable\. On more complex industrial data, full fine\-tuning may become beneficial, but the strong stability observed in linear probing indicates that SAP learns robust representations\.

Overall, the most informative comparison is therefore obtained in the linear probing regime, where representation quality can be assessed independently of full optimization\. In this setting, SAP produces stable and linearly separable features that enable near\-perfect classification with limited labeled data\. The combination of high accuracy, rapid convergence, and low variance suggests that pretext tasks such as spectral aliasing can lead to more robust and better\-structured representations for vibration\-based fault diagnosis\.

## VConclusion and Perspective

Experimental results on the CWRU dataset show that SAP produces more discriminative representations than masking\- based pretraining, achieving strong classification performance with only a small fraction of labeled data\. The method provides a stable initialization for downstream learning and improves label efficiency compared with both random initialization and MAE pretraining\. These results highlight the benefit of integrating signal processing knowledge into self\-supervised learning for industrial condition monitoring\. Future work will extend the comparison to additional SSL methods such as TS2Vec and TS\-TCC, investigate cross\-dataset generalization, analyze the impact of potential data leakage induced by overlapping window segmentation, and further justify key design choices including the symmetric spectrum concatenation strategy\.

## Acknowledgment

This work was granted access to the HPC resources of IDRIS under the allocation 20XX\-AD010114820R2 made by GENCI\.

## References

- \[1\]J\. Antoni\(2007\-07\-24\)Cyclic spectral analysis of rolling\-element bearing signals: facts and fictions\.304\(3\),pp\. 497–529\.External Links:ISSN 0022\-460X,[Link](https://www.sciencedirect.com/science/article/pii/S0022460X07001551),[Document](https://dx.doi.org/10.1016/j.jsv.2007.02.029)Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p4.1)\.
- \[2\]R\. Balestriero, M\. Ibrahim, V\. Sobal, A\. Morcos, S\. Shekhar, T\. Goldstein, F\. Bordes, A\. Bardes, G\. Mialon, Y\. Tian, A\. Schwarzschild, A\. G\. Wilson, J\. Geiping, Q\. Garrido, P\. Fernandez, A\. Bar, H\. Pirsiavash, Y\. LeCun, and M\. Goldblum\(2023\-06\-28\)A cookbook of self\-supervised learning\.arXiv\.External Links:[Link](http://arxiv.org/abs/2304.12210),[Document](https://dx.doi.org/10.48550/arXiv.2304.12210),2304\.12210 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1)\.
- \[3\]T\. Chen, S\. Kornblith, M\. Norouzi, and G\. Hinton\(2020\-07\-01\)A simple framework for contrastive learning of visual representations\.arXiv\.External Links:[Link](http://arxiv.org/abs/2002.05709),[Document](https://dx.doi.org/10.48550/arXiv.2002.05709),2002\.05709 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1)\.
- \[4\]J\. Devlin, M\. Chang, K\. Lee, and K\. Toutanova\(2019\-05\-24\)BERT: pre\-training of deep bidirectional transformers for language understanding\.arXiv\.External Links:[Link](http://arxiv.org/abs/1810.04805),[Document](https://dx.doi.org/10.48550/arXiv.1810.04805),1810\.04805 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1)\.
- \[5\]E\. Eldele, M\. Ragab, Z\. Chen, M\. Wu, C\. K\. Kwoh, X\. Li, and C\. Guan\(2021\-06\-26\)Time\-series representation learning via temporal and contextual contrasting\.arXiv\.External Links:[Link](http://arxiv.org/abs/2106.14112),[Document](https://dx.doi.org/10.48550/arXiv.2106.14112),2106\.14112 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1)\.
- \[6\]E\. Eldele, M\. Ragab, X\. Qing, Edward, Z\. Chen, M\. Wu, X\. Li, and J\. Lee\(2025\-04\-02\)UniFault: a fault diagnosis foundation model from bearing data\.arXiv\.External Links:[Link](http://arxiv.org/abs/2504.01373),[Document](https://dx.doi.org/10.48550/arXiv.2504.01373),2504\.01373 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p3.1)\.
- \[7\]K\. He, X\. Chen, S\. Xie, Y\. Li, P\. Dollár, and R\. Girshick\(2021\-12\-19\)Masked autoencoders are scalable vision learners\.arXiv\.External Links:[Link](http://arxiv.org/abs/2111.06377),[Document](https://dx.doi.org/10.48550/arXiv.2111.06377),2111\.06377 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1),[§III\-B](https://arxiv.org/html/2608.05705#S3.SS2.p1.1)\.
- \[8\]V\. Hondru, F\. A\. Croitoru, S\. Minaee, R\. T\. Ionescu, and N\. Sebe\(2025\-07\-10\)Masked image modeling: a survey\.arXiv\.External Links:[Link](http://arxiv.org/abs/2408.06687),[Document](https://dx.doi.org/10.48550/arXiv.2408.06687),2408\.06687 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1)\.
- \[9\]C\. Li, S\. Li, Y\. Feng, K\. Gryllias, F\. Gu, and M\. Pecht\(2024\-07\-23\)Small data challenges for intelligent prognostics and health management: a review\.57\(8\),pp\. 214\.External Links:ISSN 1573\-7462,[Link](https://doi.org/10.1007/s10462-024-10820-4),[Document](https://dx.doi.org/10.1007/s10462-024-10820-4)Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p1.1)\.
- \[10\]C\. Lu, Z\. Wang, and B\. Zhou\(2017\-04\-01\)Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification\.32,pp\. 139–151\.External Links:ISSN 1474\-0346,[Link](https://www.sciencedirect.com/science/article/pii/S1474034616301148),[Document](https://dx.doi.org/10.1016/j.aei.2017.02.005)Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p5.1)\.
- \[11\]NASA prognostics center of excellence data set repository \[mirror\]\(Website\)External Links:[Link](https://data.phmsociety.org/nasa/)Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p1.1)\.
- \[12\]K\. Rombach, G\. Michau, and O\. Fink\(2021\-01\)Contrastive learning for fault detection and diagnostics in the context of changing operating conditions and novel fault types\.21\(10\),pp\. 3550\.External Links:ISSN 1424\-8220,[Link](https://www.mdpi.com/1424-8220/21/10/3550),[Document](https://dx.doi.org/10.3390/s21103550)Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1)\.
- \[13\]H\. Su and J\. Lee\(2024\-09\-17\)Machine learning approaches for diagnostics and prognostics of industrial systems using open source data from PHM data challenges: a review\.15\(2\)\.External Links:ISSN 2153\-2648,[Link](https://papers.phmsociety.org/index.php/ijphm/article/view/3993),[Document](https://dx.doi.org/10.36001/ijphm.2024.v15i2.3993)Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p1.1)\.
- \[14\]Q\. Wen, T\. Zhou, C\. Zhang, W\. Chen, Z\. Ma, J\. Yan, and L\. Sun\(2023\-05\-11\)Transformers in time series: a survey\.arXiv\.External Links:[Link](http://arxiv.org/abs/2202.07125),[Document](https://dx.doi.org/10.48550/arXiv.2202.07125),2202\.07125 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p5.1)\.
- \[15\]Z\. Yue, Y\. Wang, J\. Duan, T\. Yang, C\. Huang, Y\. Tong, and B\. Xu\(2022\-06\-28\)TS2vec: towards universal representation of time series\.36\(8\),pp\. 8980–8987\.Note:Number: 8External Links:ISSN 2374\-3468,[Link](https://ojs.aaai.org/index.php/AAAI/article/view/20881),[Document](https://dx.doi.org/10.1609/aaai.v36i8.20881)Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p2.1)\.
- \[16\]A\. Zhou and A\. B\. Farimani\(2024\)FaultFormer: pretraining transformers for adaptable bearing fault classification\.12,pp\. 70719–70728\.External Links:ISSN 2169\-3536,[Link](http://arxiv.org/abs/2312.02380),[Document](https://dx.doi.org/10.1109/ACCESS.2024.3399670),2312\.02380 \[cs\]Cited by:[§I](https://arxiv.org/html/2608.05705#S1.p3.1)\.

Similar Articles

Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generation

arXiv cs.LG

This paper introduces SPARC, a spectral-algebraic theory explaining the self-correction blind spot in autoregressive language models, where models fail to correct their own errors but can fix identical external errors. The theory proves the blind spot arises when the spectral radius of an error-propagation operator is at least one, derives a threshold for correction markers, and provides convergence guarantees for RL-based self-correction training.