mica

Tag

Cards List
#mica

MiCA is now part of Hugging Face PEFT

Reddit r/LocalLLaMA · 6d ago

MiCA (Minor Component Adaptation), a new fine-tuning method that initializes adapters in the minor singular subspace for better knowledge uptake and less forgetting, has been merged into the Hugging Face PEFT library. It is available via the PEFT main branch and integrates through the existing LoRA interface with init_lora_weights='mica'.

0 favorites 0 likes
← Back to home

Submit Feedback