2 problems

0 votes0 replies0 views
The Gaussian-regime width conjecture for deep ReLU networks
Consider fully connected deep ReLU networks and their network functions in the setting of random initialization. Gaussian-regime width conjecture. A plausible explanation for the o…
Conjectureopenneural-network-theory relu-networksarXiv posted 2 days ago
0 votes0 replies2 views
Existence of double scaling limit for random neural networks
Consider a random depth $L$ neural network with input dimension $n_0$ , hidden layer widths … output dimension $n_{L+1}$ and non-linearity $\sigma$ . Suppose that the network is tune…
Conjectureopenneural-network-theory probability random-neural-networksarXiv posted 2 days ago

The Gaussian-regime width conjecture for deep ReLU networks