Trust-region framework for moment estimation constrains update steps in Adam-like optimizers; derives a family of learning-rate mechanisms based on moment constraints
Read the original at arxiv.org→arXiv:2608.04026v1 Announce Type: new Abstract: In this paper, we develop a trust-region framework for understanding the behavior of adaptive moment estimation mechanisms, such as \textsc{Adam}, in stochastic...
Original headline: "A Trust-region Framework for Moment Estimation"
Coverage timeline
- Aug 6, 04:00 UTC arXiv cs.LG lead source A Trust-region Framework for Moment Estimation