interference-calibration

Tag

Cards List
#interference-calibration

Crowded in B-Space: Calibrating Shared Directions for LoRA Merging

Hugging Face Daily Papers · 2026-04-18 Cached

This paper introduces Pico, a data-free method that improves LoRA adapter merging by separately calibrating the output-side matrix B to reduce interference from shared directions while preserving task-specific information. Pico achieves 3.4–8.3 point accuracy improvements over existing merging methods across math, coding, finance, and medical benchmarks.

0 favorites 0 likes
← Back to home

Submit Feedback