Tightness conjecture for the fat-shattering dimension of bounded affine maxima

Let BewcommandRRRdB ewcommand{\mathbb{R}}{\mathbb{R}}\subset\mathbb{R}^d be the Euclidean unit ball. For i[k]i\in[k], let

Fi={xwx+b: wbRi}F_i=\left\{x\mapsto w\cdot x+b:\ \left\Vert w\right\Vert\vee|b|\le R_i\right\}

be collections of bounded affine functions on BB, and let FmaxF_{\max} denote their kk-fold maximum. Theorem~ states that

fatγ(Fmax)cLog(k)γ2i=1kRi2,0<γ<mini[k]Ri,\operatorname{fat}_{\gamma}(F_{\max})\le \frac{c\operatorname{Log}(k)}{\gamma^2}\sum_{i=1}^kR_i^2, \qquad 0<\gamma<\min_{i\in[k]}R_i,

for a universal constant c>0c>0. Tightness conjecture. The bound in Theorem~ is tight, in the sense that it has a matching lower bound. This would establish optimality of the logarithmic dependence on kk for bounded affine function classes; the cited upper bound is presented as sharper than earlier work, while the matching lower bound remains unstated and open here.

Sources & referencesView supporting material

Primary source

Idan Attias and Aryeh Kontorovich, “Fat-Shattering Dimension of k-fold Aggregations”, arXiv:2110.04763 (2023).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.