Tightness conjecture for the fat-shattering dimension of bounded affine maxima

At least 4 years old · documented by

Let BewcommandRR⊂RdB ewcommand{\mathbb{R}}{\mathbb{R}}\subset\mathbb{R}^d be the Euclidean unit ball. For i∈[k]i\in[k], let

Fi={x↦w⋅x+b: ∥w∥∨∣b∣≤Ri}F_i=\left\{x\mapsto w\cdot x+b:\ \left\Vert w\right\Vert\vee|b|\le R_i\right\}

be collections of bounded affine functions on BB, and let Fmax⁡F_{\max} denote their kk-fold maximum. Theorem~ states that

fat⁡γ(Fmax⁡)≤cLog⁡(k)γ2∑i=1kRi2,0<γ<min⁡i∈[k]Ri,\operatorname{fat}_{\gamma}(F_{\max})\le \frac{c\operatorname{Log}(k)}{\gamma^2}\sum_{i=1}^kR_i^2, \qquad 0<\gamma<\min_{i\in[k]}R_i,

for a universal constant c>0c>0. Tightness conjecture. The bound in Theorem~ is tight, in the sense that it has a matching lower bound. This would establish optimality of the logarithmic dependence on kk for bounded affine function classes; the cited upper bound is presented as sharper than earlier work, while the matching lower bound remains unstated and open here.

References

Primary source

Idan Attias and Aryeh Kontorovich, “Fat-Shattering Dimension of k-fold Aggregations”, arXiv:2110.04763 (2023).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.