ProLand: a new infeasible manifold optimization method for LoRA fine-tuning exploits temporary infeasibility to explore near the Stiefel manifold and progressively restore orthogonality.
Read original on arXiv cs.LG ↗arXiv:2611.00236v1 Announce Type: new Abstract: Low-rank adaptation (LoRA) enables parameter-efficient fine-tuning but can suffer from redundant basis directions. Constraining the basis factor to the Stiefel...
Original headline: "ProLand: A New Infeasible Manifold Optimization Method for LoRA Fine-Tuning"
Timeline
- November 3, 2026 ProLand: A New Infeasible Manifold Optimization Method for LoRA Fine-Tuning arXiv cs.LG