The strict depth hierarchy conjecture for ReLU networks
For , let
Here, denotes the class of functions representable by ReLU neural networks with input variables and hidden layers, and denotes the class of continuous piecewise-linear functions on . The strict depth hierarchy conjecture. For every ,
The conjecture asserts that the logarithmic-depth construction representing every continuous piecewise-linear function is depth-minimal, with every additional hidden layer up to strictly increasing the representable class. Its status is not resolved in the supplied source context.
References
Primary source
Christoph Hertrich, Amitabh Basu, Marco Di Summa and Martin Skutella, “Towards Lower Bounds on the Depth of ReLU Neural Networks”, arXiv:2105.14835 (2024).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
No solutions have been posted yet.