2 problems

One-cluster convergence conjecture for causal attention with a multidimensional dominant eigenspace
Let $Q$ and $K$ be arbitrary matrices, and let $V$ be a matrix whose largest eigenvalue $\lambda_{\max}>0$ is real, with eigenspace $L$ satisfying $\mathop{\rm \dim} L\geq2$ . Assume…
openFrom paperscausal-attention clustering dynamical-systems
0 responses
4
Two-cluster convergence conjecture for causal transformer dynamics with simple dominant eigendirection
Let $Q$ and $K$ be arbitrary matrices, and let $V$ be diagonalizable with $d$ different positive real eigenvalues. Denote its largest eigenvalue by $\lambda_{\max}$ , and let $\xi$ …
openFrom paperscausal-attention clustering dynamical-systems
0 responses
6

One-cluster convergence conjecture for causal attention with a multidimensional dominant eigenspace