SeFoRA uses sketch-aggregated federated LoRA to handle heterogeneous client ranks in federated parameter-efficient fine-tuning with low-rank adaptation.
Read the original at arxiv.org→arXiv:2608.10144v1 Announce Type: new Abstract: We consider federated parameter efficient fine-tuning of large neural networks with low-rank adaptation (LoRA,~Hu et al.\ 2022). Combining LoRA with federated PEFT...
Original headline: "SeFoRA: Sketch-Aggregated Federated Low-Rank Adaptation with Heterogeneous Client Ranks"
Coverage timeline
- Aug 12, 04:00 UTC arXiv cs.LG lead source SeFoRA: Sketch-Aggregated Federated Low-Rank Adaptation with Heterogeneous Client Ranks