parameter-efficient-tuning

This paper introduces an adaptive phase-switching method for communication-efficient federated LoRA fine-tuning, achieving up to 40.5% round-trip savings in communication costs while maintaining model performance on large language models.