Ongie et al.'s finite-representation-cost conjecture for continuous piecewise linear functions
Ongie et al.'s finite-representation-cost conjecture for continuous piecewise linear functions
Let be a continuous piecewise linear function, and consider shallow ReLU neural networks, allowing either finite width or infinite width with a representation cost. Ongie et al.'s conjecture. The function has finite representation cost if and only if it is exactly representable by a finite width shallow neural network. This conjecture asks whether infinite-width shallow ReLU networks provide no additional finite-cost representations among continuous piecewise linear functions beyond those already obtainable with finite width. Many compactly supported piecewise linear functions are known not to be representable with finite cost, but the stated equivalence is unresolved in the supplied source.
Sources & referencesView supporting material
Primary source
Sarah McCarty, “Piecewise Linear Functions Representable with Infinite Width Shallow ReLU Neural Networks”, arXiv:2307.14373 (2023).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.