Without-replacement matrix-product norm conjectures

About 14 years old · traced to

Let [n]={1,…,n}[n]=\{1,\ldots,n\}, let A1,…,An\bm{A}_1,\ldots,\bm{A}_n be positive semidefinite matrices, and let kk be a positive integer. For a function of an ordered kk-tuple, define

E⁡wo[f(xi1,…,xik)]=(n−k)!n!∑j1≠j2≠⋯≠jkf(xj1,…,xjk),\operatorname{\mathbb{E}}_{\mathrm{wo}}[f(x_{i_1},\ldots,x_{i_k})]=\frac{(n-k)!}{n!}\sum_{j_1\neq j_2\neq\cdots\neq j_k}f(x_{j_1},\ldots,x_{j_k}),

and

E⁡wr[f(xi1,…,xik)]=n−k∑(j1,…,jk)=1nf(xj1,…,xjk).\operatorname{\mathbb{E}}_{\mathrm{wr}}[f(x_{i_1},\ldots,x_{i_k})]=n^{-k}\sum_{(j_1,\ldots,j_k)=1}^n f(x_{j_1},\ldots,x_{j_k}).

Here E⁡wo\operatorname{\mathbb{E}}_{\mathrm{wo}} and E⁡wr\operatorname{\mathbb{E}}_{\mathrm{wr}} denote without-replacement and with-replacement expectations, respectively. Without-replacement matrix-product norm conjectures. The following two inequalities always hold:

∥E⁡wo[∏j=1kAij]∥≤∥E⁡wr[∏j=1kAij]∥\left\|\operatorname{\mathbb{E}}_{\mathrm{wo}}\left[\prod_{j=1}^k\bm{A}_{i_j}\right]\right\|\leq\left\|\operatorname{\mathbb{E}}_{\mathrm{wr}}\left[\prod_{j=1}^k\bm{A}_{i_j}\right]\right\|

and

∥E⁡wo[∏j=1kAik−j+1∏j=1kAij]∥≤∥E⁡wr[∏j=1kAik−j+1∏j=1kAij]∥.\left\|\operatorname{\mathbb{E}}_{\mathrm{wo}}\left[\prod_{j=1}^k\bm{A}_{i_{k-j+1}}\prod_{j=1}^k\bm{A}_{i_j}\right]\right\|\leq\left\|\operatorname{\mathbb{E}}_{\mathrm{wr}}\left[\prod_{j=1}^k\bm{A}_{i_{k-j+1}}\prod_{j=1}^k\bm{A}_{i_j}\right]\right\|.

These inequalities are proposed as sufficient conditions for proving that without-replacement sampling outperforms with-replacement sampling in randomized iterative methods. The supplied text gives no resolution of either inequality.

References

Primary source

Benjamin Recht and Christopher Re, “Beneath the valley of the noncommutative arithmetic-geometric mean inequality: conjectures, case-studies, and consequences”, arXiv:1202.4184 (2012).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.