Integral inequality for nearest-neighbor classification
Let and be independent random variables, where and are densities with cumulative distribution functions and , respectively. Integral inequality conjecture. The inequality
holds. This inequality is presented as a sufficient-and-necessary reformulation of the expected-error comparison underlying the proposed nearest-neighbor rule, and its validity is left unresolved.
References
Primary source
Kevin Bleakley, “Extreme change-point detection”, arXiv:2403.19237 (2024).
Progress summary
A posted calculation claims an explicit smooth counterexample, so the inequality is false in general, but the calculation has not been independently verified.
The conjecture asks whether the displayed integral is nonnegative for all pairs of probability densities. Bleakley’s 2024 paper introduced the underlying nearest-neighbor conjecture: nearest-neighbor prediction should outperform chance for arbitrary distributions and be optimal without distributional knowledge.
Known results
- For Gaussian densities, nearest-neighbor prediction beats chance without knowing the parameters (Bleakley, 2024).
August 2026 posted counterexample
An attempted calculation takes mixtures of compactly supported uniform components centered at , , , and , and claims the integral equals . It further claims the same value for smooth compactly supported bump densities. This is presented as a complete counterexample, but it has not been independently verified.
Current status (as of August 2026): The Gaussian case is established, while a claimed smooth counterexample would refute the general inequality; that counterexample remains unverified.
Sources
Solutions 1
CounterexampleThis solution needs a summarySee full solution
The integral can be strictly negative for explicit absolutely continuous probability densities.
For , define
and take
Both are probability densities. Write , and denote the conjectured integral by . The substitution
gives
At the ordered centers , the respective component-mass vectors are
For distinct centers , all corresponding midpoints lie in the same gap between the four supports. Thus is constant on that entire block, and
The complete exact calculation is
and hence
The same construction works with smooth densities: replace every by the translate of any normalized bump supported in . Every midpoint remains in the same gap, so the exact value is unchanged.