Max-function formulation of the ReLU depth-separation conjecture
Max-function formulation of the ReLU depth-separation conjecture
Let , and let be the set of continuous piecewise linear functions on computable with hidden layers. Max-function formulation of the depth-separation conjecture. For , the function
is not contained in . This statement is presented as equivalent to the preceding depth-separation conjecture, based on a result of Wang. It is open; for example, it is unknown whether two hidden layers suffice for .
Sources & referencesView supporting material
Primary source
Christian Haase, Christoph Hertrich and Georg Loho, “Lower Bounds on the Depth of Integral ReLU Neural Networks via Lattice Polytopes”, arXiv:2302.12553 (2023).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.