The generic total H-complexity conjecture for ReLU neural network maps

From papers

Let F:RnRF:\mathbb{R}^n\rightarrow\mathbb{R} be a ReLU neural network map with canonical polyhedral decomposition C(F)\mathcal{C}(F). The total HH-complexity of FF and the 00-cells of C(F)\mathcal{C}(F) are understood as defined in the paper.

Generic total H-complexity conjecture. With probability 11, the total HH-complexity of FF is less than or equal to the number of 00-cells of C(F)\mathcal{C}(F).

The conjecture is motivated by the contrast between high-complexity PL examples with a single 00-cell and the claim that such behavior is highly atypical for ReLU neural network functions. The supplied text gives no resolution.

Progress summary

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Sources & referencesView supporting material

Primary source

J. Elisenda Grigsby, Kathryn Lindsey and Marissa Masden, “Local and global topological complexity measures OF ReLU neural network functions”, arXiv:2204.06062 (2024).

Solutions 0

No solutions have been posted yet.