Learning orthogonal multi-index models beyond small initialization: incremental learning, competitive dynamics and symmetry
Read the original at arxiv.org→arXiv:2609.10879v1 Announce Type: new Abstract: Recent work has identified incremental learning in shallow networks trained on single-index and multi-index models. However, existing analyses often rely on...
Original headline: "Learning Orthogonal Multi-Index Models Beyond Small Initialization: Incremental Learning, Competitive Dynamics and Symmetry"
Coverage timeline
- Sep 11, 04:00 UTC arXiv cs.LG lead source Learning Orthogonal Multi-Index Models Beyond Small Initialization: Incremental Learning, Competitive Dynamics and Symmetry