Tag
The paper introduces OrthoReg, a plug-and-play regularizer that enforces weight orthogonality during fine-tuning to improve task arithmetic and model merging without extra compute.