The strict depth hierarchy conjecture for ReLU networks
The strict depth hierarchy conjecture for ReLU networks
For , let
Here, denotes the class of functions representable by ReLU neural networks with input variables and hidden layers, and denotes the class of continuous piecewise-linear functions on . The strict depth hierarchy conjecture. For every ,
The conjecture asserts that the logarithmic-depth construction representing every continuous piecewise-linear function is depth-minimal, with every additional hidden layer up to strictly increasing the representable class. Its status is not resolved in the supplied source context.
Sources & referencesView supporting material
Primary source
Christoph Hertrich, Amitabh Basu, Marco Di Summa and Martin Skutella, “Towards Lower Bounds on the Depth of ReLU Neural Networks”, arXiv:2105.14835 (2024).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.