Runtime lower-bound conjecture for sparse PCA in the hard regime

Let WW be a GOE(n)\mathrm{GOE}(n) matrix, let x{0,1}nx\in\{0,1\}^n have exactly kk nonzero entries, and observe Y=λkxx+WY=\frac{\lambda}{k}xx^\top+W, with 1kn1\ll k\ll n. Exact recovery means outputting xx with probability tending to 11 as nn\to\infty.

Sparse PCA runtime conjecture. For any λ\lambda in the hard regime

k/nλmin{1,k/n},\sqrt{k/n}\ll\lambda\ll\min\{1,k/\sqrt n\},

any algorithm for exact recovery requires runtime

exp(Ω~(k2λ2n)).\exp\left(\tilde\Omega\left(\frac{k^2}{\lambda^2n}\right)\right).

This conjecture proposes a precise computational barrier in the regime where exact recovery is believed to be information-theoretically possible but no polynomial-time algorithm is known. Existing evidence includes reductions from planted clique, failure of approximate message passing, sum-of-squares lower bounds, and the overlap gap property, but those results do not establish this precise optimal-runtime expression.

Sources & referencesView supporting material

Primary source

Gérard Ben Arous, Alexander S. Wein and Ilias Zadik, “Free Energy Wells and Overlap Gap Property in Sparse PCA”, arXiv:2006.10689 (2020).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.