Align before aggregation: basis-consistent federated LoRA under heterogeneous ranks
Read the original at arxiv.org→arXiv:2611.07598v1 Announce Type: new Abstract: Federated fine-tuning of large language models (LLMs) under heterogeneous client capacities is increasingly important, and low-rank adaptation (LoRA) with...
Original headline: "Align Before Aggregation: Basis-Consistent Federated LoRA under Heterogeneous Ranks"
Coverage timeline
- Nov 6, 05:00 UTC arXiv cs.AI lead source Align Before Aggregation: Basis-Consistent Federated LoRA under Heterogeneous Ranks