All-or-nothing conjecture for higher-order Gaussian fields

Consider a higher-order Gaussian generative field of order bbbb, with load RR, channel capacity C(σ)\mathcal{C}(\sigma), overlap mm^\star, and information rate I(σ)\mathcal{I}(\sigma). There exists an order bb03bb_0\geq 3 such that, for bbbb0bb\geq bb_0, higher-order Gaussian-field conjecture.

m={1RC(σ)log2,0R>C(σ)log2,m^\star=\begin{cases}1 & R\leq \dfrac{\mathcal{C}(\sigma)}{\log 2},\\0 & R>\dfrac{\mathcal{C}(\sigma)}{\log 2},\end{cases}

and

I(σ)={Rlog2RC(σ)log2,C(σ)R>C(σ)log2.\mathcal{I}(\sigma)=\begin{cases}R\log 2 & R\leq \dfrac{\mathcal{C}(\sigma)}{\log 2},\mathcal{C}(\sigma) & R>\dfrac{\mathcal{C}(\sigma)}{\log 2}. \end{cases}

This predicts an all-or-nothing transition at Shannon's channel-capacity threshold: perfect inference below the critical load and zero overlap above it. The source motivates the claim using heuristic comparisons and numerical validation, but does not provide a proof.

Sources & referencesView supporting material

Primary source

Ali Bereyhi, Bruno Loureiro, Florent Krzakala, Ralf R. Müller and Hermann Schulz-Baldes, “Bayesian Inference with Nonlinear Generative Models: Comments on Secure Learning”, arXiv:2201.09986 (2022).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.