Zero-error realizable CMI conjecture
Zero-error realizable CMI conjecture
Let be a domain, let be a class of functions with VC dimension , and let . For a dataset , write for the empirical - loss, and let denote the conditional mutual information of an algorithm's output. Zero-error realizable CMI conjecture. The realizable conjecture above holds with ; equivalently, there exists an algorithm with whose expected empirical loss is zero on every realizable dataset.
This strengthens the realizable conjecture by requiring exact consistency rather than an error bound. It is stated as a further conjectural refinement of the proposed CMI guarantee.
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Sources & referencesView supporting material
Primary source
Thomas Steinke and Lydia Zakynthinou, “Reasoning About Generalization via Conditional Mutual Information”, arXiv:2001.09122 (2020).
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.