Kinetics of training describe a driven-nucleation rate law for emergence, plasticity loss, and circuit control in language models
Read the original at arxiv.org→arXiv:2607.27281v1 Announce Type: new Abstract: A capability appears in a language model when the last parts of its circuit align in one stochastic attempt, and getting all but one right is worth nothing. We show...
Original headline: "The Kinetics of Training: A Driven-Nucleation Rate Law for Emergence, Plasticity Loss, and Circuit Control in Language Models"
Coverage timeline
- Jul 31, 04:00 UTC arXiv cs.LG lead source The Kinetics of Training: A Driven-Nucleation Rate Law for Emergence, Plasticity Loss, and Circuit Control in Language Models