Global-minimum and strict-saddle conjecture for the third-layer synaptic objective

From papers

Let XRn×TX \in \mathbb{R}^{n \times T} satisfy CX0C_X \succ 0, and let W(t)W(t) follow the continuous-time gradient-flow feedforward synaptic dynamics. Let S\mathcal{S} denote the stationary-point set of the third-layer objective S3S_3. If ΛCm=diag(λ1C,,λmC)\Lambda_C^m=\operatorname{diag}(\lambda_1^C,\dots,\lambda_m^C) contains the mm largest eigenvalues of CXC_X, and VCm=(v1C,,vmC)V_C^m=(v_1^C,\dots,v_m^C) contains the corresponding eigenvectors, then global-minimum and strict-saddle conjecture. The global minima of S3(W)S_3(W) are precisely the points WSW^\star\in\mathcal{S} of the form

W=UΛCm(VCm),UOm.W^\star=U\Lambda_C^m(V_C^m)^\top,\qquad U\in\mathcal{O}_m.

Every other WˉS\bar W\in\mathcal{S} is a strict saddle or a maximum. This conjecture concerns the landscape of the third-level optimization problem and is supported by the paper's heuristic analysis and empirical validation, but no proof or resolution is supplied.

Progress summary

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Sources & referencesView supporting material

Primary source

Veronica Centorrino, Francesco Bullo and Giovanni Russo, “Similarity Matching Networks: Hebbian Learning and Convergence Over Multiple Time Scales”, arXiv:2506.06134 (2025).

Solutions 0

No solutions have been posted yet.