Global-minimum and strict-saddle conjecture for the third-layer synaptic objective

About 1 year old · traced to

Let X∈Rn×TX \in \mathbb{R}^{n \times T} satisfy CX≻0C_X \succ 0, and let W(t)W(t) follow the continuous-time gradient-flow feedforward synaptic dynamics. Let S\mathcal{S} denote the stationary-point set of the third-layer objective S3S_3. If ΛCm=diag⁡(λ1C,…,λmC)\Lambda_C^m=\operatorname{diag}(\lambda_1^C,\dots,\lambda_m^C) contains the mm largest eigenvalues of CXC_X, and VCm=(v1C,…,vmC)V_C^m=(v_1^C,\dots,v_m^C) contains the corresponding eigenvectors, then global-minimum and strict-saddle conjecture. The global minima of S3(W)S_3(W) are precisely the points W⋆∈SW^\star\in\mathcal{S} of the form

W⋆=UΛCm(VCm)⊤,U∈Om.W^\star=U\Lambda_C^m(V_C^m)^\top,\qquad U\in\mathcal{O}_m.

Every other Wˉ∈S\bar W\in\mathcal{S} is a strict saddle or a maximum. This conjecture concerns the landscape of the third-level optimization problem and is supported by the paper's heuristic analysis and empirical validation, but no proof or resolution is supplied.

References

Primary source

Veronica Centorrino, Francesco Bullo and Giovanni Russo, “Similarity Matching Networks: Hebbian Learning and Convergence Over Multiple Time Scales”, arXiv:2506.06134 (2025).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.