Correlations are ruining your gradient descent
Read the original at arxiv.org→arXiv:2407.10780v5 Announce Type: replace Abstract: Natural gradient descent, and the preconditioned optimizers which have followed from it, correct gradient descent by estimating curvature and applying its inverse...
Original headline: "Correlations Are Ruining Your Gradient Descent"
Coverage timeline
- Nov 4, 05:00 UTC arXiv cs.LG lead source Correlations Are Ruining Your Gradient Descent