Time-Series Foundation Model Embeddings for Remaining Useful Life Estimation

Hugging Face Daily Papers Papers

Summary

This paper introduces a lightweight approach for remaining useful life estimation using frozen embeddings from the Chronos-2 time-series foundation model combined with a simple regression head, achieving superior performance on industrial sensor data compared to baseline methods.

Remaining Useful Life (RUL) prediction is essential for industrial predictive maintenance, yet many learning-based approaches rely on extensive feature engineering or large labeled datasets to train task-specific sequence models. In this work, we introduce a lightweight learning approach, in which we leverage a frozen pretrained time-series foundation model (TSFM) and combine it with a small regression head for RUL estimation from multivariate sensor streams. More specifically, we use Chronos-2 as a frozen backbone to extract context window features and train a lightweight regression neural network for RUL prediction. Experiments on real-world industrial sensor data from two device types show that Chronos-2 features consistently improve over recurrent, convolutional, Transformer-based, and gradient-boosting baselines under the same preprocessing and evaluation protocol. We further analyze the impact of context length and find that performance improves significantly with longer histories, indicating that TSFM representation offer a practical and data-efficient alternative for RUL estimation in industrial settings.
Original Article
View Cached Full Text

Cached at: 06/11/26, 01:37 PM

Paper page - Time-Series Foundation Model Embeddings for Remaining Useful Life Estimation

Source: https://huggingface.co/papers/2606.11990

Abstract

A lightweight approach combining a frozen pretrained time-series foundation model with a simple regression head achieves superior RUL prediction performance compared to various baseline methods on industrial sensor data.

Remaining Useful Life (RUL) prediction is essential forindustrial predictive maintenance, yet many learning-based approaches rely on extensive feature engineering or large labeled datasets to train task-specific sequence models. In this work, we introduce a lightweight learning approach, in which we leverage a frozen pretrainedtime-series foundation model(TSFM) and combine it with a small regression head forRUL estimationfrommultivariate sensor streams. More specifically, we useChronos-2as afrozen backboneto extractcontext window featuresand train a lightweightregression neural networkfor RUL prediction. Experiments on real-world industrial sensor data from two device types show thatChronos-2features consistently improve over recurrent, convolutional, Transformer-based, and gradient-boosting baselines under the same preprocessing and evaluation protocol. We further analyze the impact of context length and find that performance improves significantly with longer histories, indicating that TSFM representation offer a practical and data-efficient alternative forRUL estimationin industrial settings.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2606\.11990

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2606.11990 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2606.11990 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2606.11990 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

A decoder-only foundation model for time-series forecasting

Papers with Code Trending

This article presents a research paper on Time-Series Foundation Model (TimeFM), a decoder-only model that achieves near-optimal zero-shot performance across diverse time-series datasets by adapting large language model techniques.