spectral-clipping

This paper investigates singular components in LoRA and proposes SCLoRA, a method that uses spectral clipping to improve task adaptation while reducing catastrophic forgetting of pre-trained knowledge.