FARO: Function-space adaptive return-to-risk optimization via cross-block equal-risk-contribution budget allocation
Read the original at arxiv.org→arXiv:2610.40858v1 Announce Type: new Abstract: Training a large language model is compute-bound, and current recipes divide the work between optimizers by hand: orthogonalized momentum for attention and MLP...
Original headline: "FARO: Function-Space Adaptive Return-to-Risk Optimization via Cross-Block Equal-Risk-Contribution Budget Allocation"
Coverage timeline
- Nov 2, 05:00 UTC arXiv cs.LG lead source FARO: Function-Space Adaptive Return-to-Risk Optimization via Cross-Block Equal-Risk-Contribution Budget Allocation