Every Layer Counts: An exponential L2 depth hierarchy for ReLU networks
Read the original at arxiv.org→arXiv:2608.23877v1 Announce Type: new Abstract: We prove a depth hierarchy for ReLU neural networks in which every additional ReLU layer can save exponentially many neurons. For every $\ell\geq 3$, a globally...
Original headline: "Every Layer Counts: An Exponential $L_2$ Depth Hierarchy for ReLU Networks"
Coverage timeline
- Aug 26, 04:00 UTC arXiv cs.LG lead source Every Layer Counts: An Exponential $L_2$ Depth Hierarchy for ReLU Networks