Kronecker Product Attention: memory-efficient KV compression via structured factorization
Read the original at arxiv.org→arXiv:2610.12657v1 Announce Type: new Abstract: Efficient autoregressive generation is increasingly limited by the memory footprint of the key-value (KV) cache, which grows linearly with sequence length, batch size,...
Original headline: "Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization"
Coverage timeline
- Oct 12, 04:00 UTC arXiv cs.LG lead source Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization