When the preconditioning exponent turns negative: learning-rate coupling and cross-environment generalization
Read the original at arxiv.org→arXiv:2609.30271v1 Announce Type: new Abstract: Adaptive optimizers are commonly parameterized by a fixed power of the second-moment estimate. Existing partially adaptive methods study exponents between...
Original headline: "When the Preconditioning Exponent Turns Negative: Learning-Rate Coupling and Cross-Environment Generalization"
Coverage timeline
- Sep 28, 04:00 UTC arXiv cs.LG lead source When the Preconditioning Exponent Turns Negative: Learning-Rate Coupling and Cross-Environment Generalization