Conjecture on long-time concentration in a dominant eigenspace of the interaction matrix

From papers

Let BB and VV be weight matrices satisfying Assumption~, with VIdV\neq\mathrm{Id}, and let (ρtβ)t0(\rho_t^\beta)_{t\geq 0} be the token-distribution evolution on Sd1{\mathbb S}^{d-1}. Let FF be the eigenspace of VV associated with its largest eigenvalue, and let FabsF^{\mathrm{abs}} be the eigenspace associated with an eigenvalue of largest magnitude. For a probability measure ρP(Sd1)\rho_\infty\in\mathcal{P}({\mathbb S}^{d-1}), write supp(ρ)\operatorname{supp}(\rho_\infty) for its support. Dominant-eigenspace concentration conjecture. There exist weight matrices BB and VIdV\neq\mathrm{Id} satisfying Assumption~, and a probability measure ρP(Sd1)\rho_\infty\in\mathcal{P}({\mathbb S}^{d-1}) supported on FSd1F\cap{\mathbb S}^{d-1} or FabsSd1F^{\mathrm{abs}}\cap{\mathbb S}^{d-1} such that

limtW2(ρtβ,ρ)=0.\lim_{t\to\infty}W_2(\rho_t^\beta,\rho_\infty)=0.

Numerical evidence and asymptotic stability results support convergence toward a dominant eigenspace at long times, beyond the O(logβ)\mathcal{O}(\log\beta) time scale. The conjecture is trivial when V=IdV=\mathrm{Id}, while the nontrivial case concerns general interactions with VIdV\neq\mathrm{Id}; the supplied text does not establish the claim.

Progress summary

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Sources & referencesView supporting material

Primary source

Albert Alcalde, Leon Bungert, Konstantin Riedl and Tim Roith, “Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime”, arXiv:2605.10931 (2026).

Solutions 0

No solutions have been posted yet.