The agreement property for independently trained classifiers
Let be a classifier family and let be a distribution. For independent train sets , let be classifiers trained on , respectively. The test accuracy is the probability that , while the agreement property. For certain classifier families and distributions , these probabilities are approximately equal:
Moreover, with high probability over the trained classifiers , the corresponding probabilities over are approximately equal. This is proposed as an instantiation of the paper's indistinguishability conjecture; it is provable for 1-nearest neighbors in some settings, but the general claim's resolution is not specified.
References
Primary source
Preetum Nakkiran and Yamini Bansal, “Distributional Generalization: A New Kind of Generalization”, arXiv:2009.08092 (2020).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
No solutions have been posted yet.