The phase-transition conjecture for weighted PCA recovery

Let nn and dd tend to infinity so that the sample-to-dimension ratio satisfies n/dc>0n/d\to c>0, and let the noise variance proportions satisfy n/npn_\ell/n\to p_\ell for =1,,L\ell=1,\dots,L. For component ii, let A(βi)A(\beta_i) denote the quantity governing the asymptotic recoveries, and let u^i,uj,z^i,zj\hat{u}_i,u_j,\hat{z}_i,z_j, and the weighted inner product ,W2\langle\cdot,\cdot\rangle_{\mathbf{W}^2} be as in the paper.

Phase-transition conjecture. If A(βi)0A(\beta_i)\leq 0, then

j=1ku^i,uj2a.s.0,j=1kz^in,zjnW22a.s.0.\sum_{j=1}^k|\langle\hat{u}_i,u_j\rangle|^2\overset{\mathrm{a.s.}}{\longrightarrow}0, \qquad \sum_{j=1}^k\left|\left\langle\frac{\hat{z}_i}{\sqrt n},\frac{z_j}{\sqrt n}\right\rangle_{\mathbf{W}^2}\right|^2\overset{\mathrm{a.s.}}{\longrightarrow}0.

Equivalently, the formulas for the asymptotic component and score recoveries extend to A(βi)0A(\beta_i)\leq0 by truncating ri(u)r_i^{(u)} and ri(z)r_i^{(z)} at zero.

This conjectures a phase transition at A(βi)=0A(\beta_i)=0: beyond the threshold, both component and weighted score recoveries have zero asymptotic overlap. The cited asymptotic recovery formulas are stated only when A(βi)>0A(\beta_i)>0, so the extension to the nonpositive regime remains open.

Sources & referencesView supporting material

Primary source

David Hong, Fan Yang, Jeffrey A. Fessler and Laura Balzano, “Optimally Weighted PCA for High-Dimensional Heteroscedastic Data”, arXiv:1810.12862 (2022).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.