What if a model could only learn what trusted LoRA adapters can express? [R]
Summary
This research explores the concept of constraining a model's learning to only what trusted LoRA adapters can express, aiming to improve safety and reliability in fine-tuning.
Similar Articles
LoREnc: Low-Rank Encryption for Securing Foundation Models and LoRA Adapters
LoREnc is a training-free framework that secures foundation models and LoRA adapters via spectral truncation and compensation, preventing unauthorized model recovery while maintaining performance for authorized users. Accepted at ICIP 2026.
Parameter-Efficient Fine-Tuning with Learnable Rank
Researchers from Adelaide University introduce LR-LoRA (Learnable Rank LoRA), a parameter-efficient fine-tuning method that dynamically learns the adapter rank for each transformer layer during training rather than using a fixed global rank. LR-LoRA achieves state-of-the-art performance on language understanding and commonsense reasoning benchmarks, outperforming fixed-rank LoRA baselines.
Compliance2LoRA: On-Demand Safety Alignment on Arbitrary Policy Subsets via Hypernetwork-Generated LoRA Adapters
Compliance2LoRA proposes a hypernetwork-based framework that generates policy-compliant LoRA adapters on demand for large reasoning models, enabling adjustable safety alignment across arbitrary policy subsets without retraining separate models.
Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
Hybrid-LoRA proposes a framework that selectively applies full fine-tuning to a small subset of modules while using LoRA for the rest, achieving performance near full fine-tuning with significantly lower computational cost. Experiments show improvements of up to 5.65% over existing parameter-efficient baselines.
CSULoRA: Closest Safe Update Low-Rank Adaptation
CSULoRA is a post-hoc method for correcting trained LoRA adapters to preserve safety alignment while maintaining utility, using closest safe update estimation.