AdaBoost's near-optimal convergence conjecture for ternary feature matrices

About 15 years old · traced to

Let mm be the number of training examples and suppose the feature matrix has entries in {−1,0,+1}\{-1,0,+1\}. Let LL denote the exponential loss and let inf⁡λL(λ)\inf_{\bm{\lambda}}L(\bm{\lambda}) be its optimal value. Near-optimal convergence conjecture. For every ε>0\varepsilon>0, AdaBoost reaches loss at most inf⁡λL(λ)+ε\inf_{\bm{\lambda}}L(\bm{\lambda})+\varepsilon within

2O(mln⁡m)ε−(1+o(1))2^{O(m\ln m)}\varepsilon^{-(1+o(1))}

rounds. Existing bounds in the paper have comparable dependence on mm but worse dependence on ε\varepsilon; this conjecture would give a nearly optimal rate.

References

Primary source

Indraneel Mukherjee, Cynthia Rudin and Robert E. Schapire, “The Rate of Convergence of AdaBoost”, arXiv:1106.6024 (2011).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.