Rivest's optimality conjecture for correlated sampling

From papers

Let [n]={1,,n}[n]=\{1,\ldots,n\}, let U(A)\mathcal{U}(A) denote the uniform distribution on a finite set AA, and let (f,g)(f,g) be probabilistic strategies satisfying the correctness condition for correlated sampling. For positive integers n,a,b,n,a,b,\ell with 2\ell\geq 2 and na+bn\geq a+b-\ell, consider sets A,B[n]A,B\subseteq[n] with A=a|A|=a, B=b|B|=b, and AB=|A\cap B|=\ell. Rivest's conjecture. For every such n,a,b,n,a,b,\ell and every pair (f,g)(f,g), there exist sets A,B[n]A,B\subseteq[n] with these sizes such that

Pr[f(A)g(B)]1a+b=1ABAB.\Pr[f(A)\ne g(B)]\geq 1-\frac{\ell}{a+b-\ell}=1-\frac{|A\cap B|}{|A\cup B|}.

This conjecture asserts that Broder's MinHash correlated-sampling strategy is optimal except in the case of intersection size one covered by Rivest's protocol. The paper's main result proves the asserted lower bound for constant-fraction intersections, while the fully general statement remains open.

Progress summary

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Sources & referencesView supporting material

Primary source

Mohammad Bavarian, Badih Ghazi, Elad Haramaty, Pritish Kamath, Ronald L. Rivest and Madhu Sudan, “Optimality of Correlated Sampling Strategies”, arXiv:1612.01041 (2020).

Solutions 0

No solutions have been posted yet.