Continuum Attention
By Afshin Khadangi · Paper · cs.LG
We introduce Continuum Attention (CA), a causal Transformer attention operator that replaces discrete key and value lookup with integration over a continuous, piecewise linear memory curve. Each query induces an exponential relevance density along the curve. Integrating the densi
Tags: Cs.lg