spectral-preconditioning

Tag

Cards List
#spectral-preconditioning

In-span learning: adapting reduced-order models using their own predictions

arXiv cs.LG · 2026-07-07 Cached

Introduces in-span learning, a method to adapt reduced-order models by streaming the model's own predictions through an incremental singular-value decomposition, reweighting and realigning the basis without changing the subspace. The approach is demonstrated on several dynamical systems and proposed as a computational-science analogue of in-context learning.

0 favorites 0 likes
#spectral-preconditioning

FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning

arXiv cs.LG · 2026-05-25 Cached

FuRA introduces a full-rank parameter-efficient fine-tuning method using spectral preconditioning via block tensor-train decomposition, achieving higher accuracy than full fine-tuning with LoRA-level efficiency. It outperforms LoRA and full FT on LLM and VLM tasks.

0 favorites 0 likes
← Back to home

Submit Feedback