Continuum Attention: a causal Transformer attention operator using continuous memory curve for exact normalized attention from exponential moments

We introduce Continuum Attention (CA), a causal Transformer attention operator that replaces discrete key and value lookup with integration over a continuous, piecewise linear memory curve. Each query induces an...