TEMPER: Tensorized Efficient Manifold-constrained Parameterization for Expressive Residual Routing

arXiv:2608.07851v1 Announce Type: new Abstract: Residual connections rely on a static residual pathway, and are essential for training deep neural networks. Hyper-connections (HC) increase the expressivity of...