Sample-Adaptive zeroth-order post-training; SAZO learns sample importance online to allocate queries adaptively for faster fine-tuning of large language models.
Read the original at arxiv.org→arXiv:2610.12566v1 Announce Type: new Abstract: Zeroth-order (ZO) optimization offers a memory-efficient alternative to backpropagation for fine-tuning large language models. However, existing ZO methods typically...
Original headline: "Sample-Adaptive Zeroth-Order Post-Training"
Coverage timeline
- Oct 12, 04:00 UTC arXiv cs.LG lead source Sample-Adaptive Zeroth-Order Post-Training