Sparse Gaussian mean estimation communication–risk conjecture

Let PPsP\in\mathcal{P}_s be a distribution with mean, and suppose a protocol estimates that mean with mean-squared loss RR and communication cost CC. The parameters are the sparsity level ss, dimension dd, noise variance σ2\sigma^2, and number of machines and samples m,nm,n.

Sparse estimation tradeoff conjecture. If some protocol estimates the mean for any distribution PPsP\in\mathcal{P}_s with mean-squared loss RR and communication cost CC, then

CRsdσ2mn,C\cdot R \gtrsim \frac{sd\sigma^2}{mn},

where \gtrsim hides logarithmic factors and potential corner cases.

This conjecture asserts that the proposed sparse-parameter protocol has an essentially optimal communication–risk tradeoff, modulo logarithmic factors and possible boundary cases; the source gives no resolution.

Sources & referencesView supporting material

Primary source

Ankit Garg, Tengyu Ma and Huy L. Nguyen, “On Communication Cost of Distributed Statistical Estimation and Dimensionality”, arXiv:1405.1665 (2014).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.