BF1: A deterministic block-aligned dyadic sparse-attention retrofit for efficient long-context transformers
Read the original at arxiv.org→arXiv:2608.20427v1 Announce Type: new Abstract: Dense causal attention remains expensive at long context even when implemented with highly optimized exact kernels. We study BF1, a deterministic block-aligned dyadic...
Original headline: "BF1: A Causal Dyadic Sparse-Attention Retrofit for Efficient Long-Context Transformers"
Coverage timeline
- Aug 24, 04:00 UTC arXiv cs.LG lead source BF1: A Causal Dyadic Sparse-Attention Retrofit for Efficient Long-Context Transformers