Subspace node pruning reduces network size by removing nodes via a common quadratic form in a pruning subspace

arXiv:2405.17506v4 Announce Type: replace Abstract: Node pruning is the art of removing computational units such as neurons, filters, attention heads, or even entire layers to significantly reduce inference time...