Asymptotic convergence-rate conjecture for iterative hard thresholding in matrix completion

Let Hn=Wpqn(Wpqn)\bm H_n=\bm W_{pq}^{n}(\bm W_{pq}^{n})^{\top} be the matrix from Theorem~, where Wqn=Vn2Un1\bm W_q^n=\bm V_{\perp}^{n_2}\otimes\bm U_{\perp}^{n_1} forms a concentrated sequence of semi-orthogonal matrices, and let ρ\rho be the linear rate defined in. As mm\to\infty, assume the same setting as in Theorem~. Asymptotic convergence-rate conjecture. The linear rate ρ\rho converges almost surely to p=1λp_\infty=1-\lambda^-, where λ\lambda^- is the lower endpoint of the limiting spectral distribution in, as given in. This conjecture predicts that the smallest eigenvalue of Hn\bm H_n converges to λ\lambda^-, so the asymptotic linear convergence rate is determined by the lower edge of the limiting spectrum. The preceding theorem establishes convergence of the empirical spectral distribution, but does not establish convergence of its smallest eigenvalue; the almost-sure convergence of ρ\rho therefore remains conjectural.

Sources & referencesView supporting material

Primary source

Trung Vu, Evgenia Chunikhina and Raviv Raich, “On Asymptotic Linear Convergence Rate of Iterative Hard Thresholding for Matrix Completion”, arXiv:2112.14733 (2022).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.