AdaBoost's near-optimal convergence conjecture for ternary feature matrices

Let mm be the number of training examples and suppose the feature matrix has entries in {1,0,+1}\{-1,0,+1\}. Let LL denote the exponential loss and let infλL(λ)\inf_{\bm{\lambda}}L(\bm{\lambda}) be its optimal value. Near-optimal convergence conjecture. For every ε>0\varepsilon>0, AdaBoost reaches loss at most infλL(λ)+ε\inf_{\bm{\lambda}}L(\bm{\lambda})+\varepsilon within

2O(mlnm)ε(1+o(1))2^{O(m\ln m)}\varepsilon^{-(1+o(1))}

rounds. Existing bounds in the paper have comparable dependence on mm but worse dependence on ε\varepsilon; this conjecture would give a nearly optimal rate.

Sources & referencesView supporting material

Primary source

Indraneel Mukherjee, Cynthia Rudin and Robert E. Schapire, “The Rate of Convergence of AdaBoost”, arXiv:1106.6024 (2011).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.