Petersen–Raslan–Voigtlaender ReLU realization-space closedness conjecture
For every fixed ReLU-network architecture and input domain , the realization space of functions represented by networks with architecture is closed in with respect to the uniform topology; equivalently, if a sequence converges uniformly on to , then .
References
- The Geometry of Limits in ReLU Function Spaces — arXiv — Kathryn A. Lindsey
Source: arXiv
Progress summary
A new preprint claims to refute the general conjecture with a concrete counterexample, while closedness still holds for some simpler network architectures.
Petersen, Raslan, and Voigtlaender conjectured that fixed-complexity ReLU realization spaces are closed in the uniform topology . Earlier work established important special cases but left the general question open.
Known results
- Fixed-architecture ReLU realization spaces can be non-closed in norms (Petersen, Raslan, and Voigtlaender, 2020).
- Two-layer ReLU realization spaces are closed in the uniform norm, including on compact boxes.
- Closedness was also proved for architectures with bounded scaling weights.
October 2026 counterexample
Kathryn A. Lindsey's preprint The Geometry of Limits in ReLU Function Spaces claims closedness for fixed-width shallow scalar architectures in one norm setting, but gives an explicit counterexample under weighted global and compact-uniform convergence. If correct, this refutes the broad closedness conjecture; the result is presently unverified.
Current status (as of October 2026): The general conjecture is claimed refuted by Lindsey's explicit counterexample, but that claim is unverified; closedness questions for restricted architectures and topologies remain open.
Solutions 0
No solutions have been posted yet.