Low-Degree Conjecture for hypothesis testing

Let N\P_N and \QN\Q_N be distributions on RN\mathbb{R}^N, and let χ2(N\QN):=E\x\QN[dN(\x)d\QN(\x)]21\chi^2(\P_N\|\Q_N):=\mathbb{E}_{\x\sim\Q_N}\left[\frac{d\P_N(\x)}{d\Q_N(\x)}\right]^2-1. Write χD2(N\QN)\chi^2_{\leq D}(\P_N\|\Q_N) for its projection onto the space of degree-DD polynomials. Strong detection means success probability 1o(1)1-o(1), while weak detection means success probability 12+ϵ\frac12+\epsilon for some constant ϵ>0\epsilon>0. Low-Degree Conjecture. If χD2(N\QN)=O(1)\chi^2_{\leq D}(\P_N\|\Q_N)=O(1) for some D=ω(logN)D=\omega(\log N), strong detection has no polynomial-time algorithm and requires runtime exp(Ω~(D))\exp(\widetilde\Omega(D)); if χD2(N\QN)=o(1)\chi^2_{\leq D}(\P_N\|\Q_N)=o(1) for some D=ω(logN)D=\omega(\log N), weak detection has no polynomial-time algorithm and requires runtime exp(Ω~(D))\exp(\widetilde\Omega(D)). The low-degree framework gives a common heuristic for computational lower bounds in problems such as sparse PCA, Planted Clique, and community detection, but the asserted connection to general polynomial-time algorithms remains conjectural.

Sources & referencesView supporting material

Primary source

Gabriel Arpino and Ramji Venkataramanan, “Statistical-Computational Tradeoffs in Mixed Sparse Linear Regression”, arXiv:2303.02118 (2023).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.