Scaling and renormalization in neural networks: an effective renormalization-group description of grokking
Read the original at arxiv.org→arXiv:2610.36113v1 Announce Type: new Abstract: Grokking is a delayed transition from memorization to generalization in deep neural networks (NNs). We examine whether scaling and renormalization group (RG) theories...
Original headline: "Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of Grokking"
Coverage timeline
- Oct 28, 04:00 UTC arXiv cs.LG lead source Scaling and Renormalization in Neural Networks: An Effective Renormalization-Group Description of Grokking