Asymptotic expected-dimension conjecture for polynomial neural network neurovarieties
Asymptotic expected-dimension conjecture for polynomial neural network neurovarieties
Let be a fixed vector of widths, with for , and let denote the activation degree. The neurovariety is the image variety associated with this architecture, and its expected dimension is the dimension predicted by the parameter count and ambient dimension.
Asymptotic expected-dimension conjecture. There exists a threshold such that, whenever , the neurovariety attains the expected dimension.
The claim concerns eventual non-defectivity as the activation degree grows. It was previously asserted as a theorem, but the proof contained a mistake; the statement has subsequently been proved in the cited work on activation functions.
Sources & referencesView supporting material
Primary source
Kaie Kubjas, Jiayi Li and Maximilian Wiesmann, “Geometry of Polynomial Neural Networks”, arXiv:2402.00949 (2024).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.