Beyond Rotations: AuroOFT enables expressive quantized orthogonal fine-tuning with gated low-rank corrections
Read the original at arxiv.org→arXiv:2608.05253v1 Announce Type: new Abstract: Quantized orthogonal fine-tuning (qoft) enables parameter-efficient adaptation of low-bit language models by learning structured activation rotations before frozen...
Original headline: "Beyond Rotations: AuroOFT for Expressive Quantized Orthogonal Fine-Tuning"
Coverage timeline
- Aug 7, 04:00 UTC arXiv cs.LG lead source Beyond Rotations: AuroOFT for Expressive Quantized Orthogonal Fine-Tuning