Continual Learning in Transition

Hugging Face Daily Papers Papers
continual-learning survey adaptive-systems machine-learning ai-research

Summary

This paper surveys the evolution of continual learning from parameter-centric methods to system-level adaptation, proposing a tri-axial framework (When, How, Where) to characterize learning across pre-training, post-training, and inference stages.

Classical continual learning (CL) has primarily focused on enabling models to update and retain knowledge through parameter-centric mechanisms, e.g., training strategies, architectural designs, and weight adaptation. However, emerging paradigms are reshaping the scope of CL beyond this traditional model adaptation view. For instance, on-policy learning broadens the space of update mechanisms; test-time training extends CL from the training phase to inference; and external harness components such as memory, skill libraries, and interaction protocols extend the evolutionary boundaries of model capabilities far beyond the static parameter space. Collectively, these developments indicate a transition from parameter-centric learning toward system-level adaptation. To characterize this transition, we examine the evolution of continual learning through three dimensions: When, How, and Where learning occurs. The How dimension encompasses off-policy, on-policy, and beyond-gradient optimization mechanics. The When dimension captures evolution across pre-training, post-training, and inference-time stages. The Where dimension delineates updates occurring within internal parameters versus external structural constraints. Anchored by this tri-axial framework, we systematically survey representative methods, trace the ongoing transition of continual learning, and discuss the key challenges, broader implications, and future directions arising from this paradigm shift.
Original Article
View Cached Full Text

Cached at: 08/07/26, 09:56 AM

Paper page - Continual Learning in Transition

Source: https://huggingface.co/papers/2608.06216 Authors:

,

,

,

,

,

,

,

,

,

,

,

Abstract

Classicalcontinuallearning(CL)hasprimarilyfocusedonenablingmodelstoupdateandretainknowledgethroughparameter-centricmechanisms,e.g.,trainingstrategies,architecturaldesigns,andweightadaptation.However,emergingparadigmsarereshapingthescopeofCLbeyondthistraditionalmodeladaptationview.Forinstance,on-policylearningbroadensthespaceofupdatemechanisms;test-timetrainingextendsCLfromthetrainingphasetoinference;andexternalharnesscomponentssuchasmemory,skilllibraries,andinteractionprotocolsextendtheevolutionaryboundariesofmodelcapabilitiesfarbeyondthestaticparameterspace.Collectively,thesedevelopmentsindicateatransitionfromparameter-centriclearningtowardsystem-leveladaptation.Tocharacterizethistransition,weexaminetheevolutionofcontinuallearningthroughthreedimensions:When,How,andWherelearningoccurs.TheHowdimensionencompassesoff-policy,on-policy,andbeyond-gradientoptimizationmechanics.TheWhendimensioncapturesevolutionacrosspre-training,post-training,andinference-timestages.TheWheredimensiondelineatesupdatesoccurringwithininternalparametersversusexternalstructuralconstraints.Anchoredbythistri-axialframework,wesystematicallysurveyrepresentativemethods,tracetheongoingtransitionofcontinuallearning,anddiscussthekeychallenges,broaderimplications,andfuturedirectionsarisingfromthisparadigmshift.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2608\.06216

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2608.06216 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2608.06216 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2608.06216 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

When Does Continual Learning Require Learning

arXiv cs.LG

This paper proposes a unified framework for continual learning in LLMs, disentangling change along space (new domains) and time (data drift). It evaluates various methods including prompting, supervised learning, reinforcement learning, and context compression under realistic sequential settings.

Homeostatic Continual Learning

arXiv cs.AI

This paper proposes Homeostatic Continual Learning, a method that enables AI agents to learn continuously in changing environments without catastrophic forgetting by detecting outliers and incrementally expanding world models.

I just solved continual learning

Reddit r/artificial

The article proposes a method for continual learning in AI where the model autonomously decides what to learn and updates its weights in real-time, potentially enabling continuous self-evolution towards AGI.

Fast and Slow Variational Continual Learning

arXiv cs.LG

This paper introduces the Continual IVON (CoVON) optimizer, which integrates fast and slow adaptation into variational continual learning to balance stability and plasticity, outperforming existing methods in domain-incremental learning, continual pre-training, and fine-tuning of large language models.