adapter-interference

Tag

Cards List
#adapter-interference

PermDoRA -- Understanding Adapter Interference in Language Models: Limits of Parameter-Space Geometry

arXiv cs.LG · 2026-06-11 Cached

This paper introduces DoRA-RBAC, a framework for composing LLM adapters, and tests whether geometry-aware merging improves multi-domain performance. Results show no consistent advantage over standard averaging, suggesting adapter interference is not primarily driven by parameter-space geometry.

0 favorites 0 likes
← Back to home

Submit Feedback