Kalman Delta Networks: Uncertainty-aware Associative Memory
7 Sep 2026
Linear attention is increasingly used in frontier language models for efficient long-context inference and constant-memory decoding. Its fixed-size recurrent memory, however, requires an online decision at each token: what to write and how strongly to overwrite existing…