Drive vs. Decay: On the Training Dynamics of Joint-Embedding Predictive Architectures
Read the original at arxiv.org→arXiv:2610.02344v1 Announce Type: new Abstract: Joint-Embedding Predictive Architectures (JEPAs) are prone to representation collapse, typically mitigated through empirical heuristics. We develop an early-training...
Coverage timeline
- Oct 5, 04:00 UTC arXiv cs.LG lead source Drive vs. Decay: On the Training Dynamics of Joint-Embedding Predictive Architectures