Geodesic Normalization keeps hidden states on a hypersphere by orthogonalizing layer outputs and updating via the Riemannian exponential map
Read the original at arxiv.org→arXiv:2608.02668v1 Announce Type: new Abstract: Residual connections are the de facto mechanism for training deep neural networks stably. Geodesic Normalization (GeoNorm) recasts them on a Riemannian manifold,...
Original headline: "Sphere Retraction Normalizations"
Coverage timeline
- Aug 5, 04:00 UTC arXiv cs.LG lead source Sphere Retraction Normalizations