LayerTrim trims redundant decoder MLP features to preserve attention in reasoning language models; announces a training-free structured pruning method for reducing inference costs
Read the original at arxiv.org→arXiv:2610.19121v1 Announce Type: new Abstract: Structured pruning reduces LLM inference costs by removing model components to produce smaller dense models. However, existing methods can cause reasoning performance...
Original headline: "Unlocking Structured Pruning for Reasoning Language Models via Attention-Preserving MLP Trimming"
Coverage timeline
- Oct 15, 04:00 UTC arXiv cs.LG lead source Unlocking Structured Pruning for Reasoning Language Models via Attention-Preserving MLP Trimming