DoSA: Dots Sparse Attention uses a seed set to condition sparse attention with a lower-bound threshold for Top-K selection

arXiv:2610.13990v1 Announce Type: new Abstract: Sparse attention visits few keys, yet finding them can still require scoring every key with every indexer head. We introduce DoSA (Dots Sparse Attention), a lossless...