SingularClip: preventing spectral collapse to maintain plasticity in continual and reinforcement learning
Read the original at arxiv.org→arXiv:2608.18319v1 Announce Type: new Abstract: Neural networks trained on nonstationary tasks frequently lose the ability to fit new targets, a phenomenon referred to as loss of plasticity. We identify a novel...
Original headline: "SingularClip: Preventing Spectral Collapse to Maintain Plasticity in Continual and Reinforcement Learning"
Coverage timeline
- Aug 20, 04:00 UTC arXiv cs.LG lead source SingularClip: Preventing Spectral Collapse to Maintain Plasticity in Continual and Reinforcement Learning