Stiefel-AdamW: geometry-aware AdamW for linear factorization blocks
Read the original at arxiv.org→arXiv:2609.21039v1 Announce Type: new Abstract: A pervasive structural pattern in modern deep learning is the linear factorization block: a submodule of the form $W = BA$ in which two parameter matrices are...
Original headline: "Stiefel-AdamW: Geometry-Aware AdamW for Linear Factorization Blocks"
Coverage timeline
- Sep 21, 04:00 UTC arXiv cs.LG lead source Stiefel-AdamW: Geometry-Aware AdamW for Linear Factorization Blocks