ADIndex: Layer-adaptive sparse attention indexing via group-level distillation
Read the original at arxiv.org→arXiv:2611.12956v1 Announce Type: new Abstract: DeepSeek Sparse Attention (DSA) reduces the computational cost of attention through token-level selection. However, its indexer still scores the entire causal prefix...
Original headline: "ADIndex: Layer-Adaptive Sparse Attention Indexing via Group-Level Distillation"
Coverage timeline
- Nov 11, 05:00 UTC arXiv cs.LG lead source ADIndex: Layer-Adaptive Sparse Attention Indexing via Group-Level Distillation