On Lipschitz explosion in deep neural networks with normalization; implications for optimization and adversarial robustness
Read the original at arxiv.org→arXiv:2611.08775v1 Announce Type: new Abstract: Can a network look stable at every layer and still be exponentially unstable as a whole? The Lipschitz constant of a neural network is a basic stability quantity...
Original headline: "On Lipschitz Explosion in Deep Neural Networks with Normalization: Consequences for Optimization and Adversarial Robustness"
Coverage timeline
- Nov 9, 05:00 UTC arXiv cs.LG lead source On Lipschitz Explosion in Deep Neural Networks with Normalization: Consequences for Optimization and Adversarial Robustness