6 problems
- 0 votes0 replies0 views
Hellinger-kernel conjecture for trained diffusion-model NTKs
Let be the neural tangent kernel of a diffusion model and let denote the Hellinger kernel of its data distribution. A Hellinger kernel is understood here as the uniq…
- 0 votes0 replies0 views
Kernel-convolution conjecture for the inductive bias of neural score approximators
Let the score be approximated by a neural network, for example in the neural tangent kernel regime, and let the neural tangent kernel (NTK) have an equivalent kernel. Kernel-convol…
- 0 votes0 replies0 views
Random evolving neural tangent kernel conjecture for MoGPs
Random evolving neural tangent kernel conjecture. In the MoGP case, when the Lévy measure is non-trivial, the infinite-width limit should yield a random kernel, and this kernel sho…
- 0 votes0 replies0 views
Order-of-limits conjecture for smooth neural-network asymptotics
For the neural-network model , let denote the depth and the dimension, and consider the limits in which both parameters grow unboundedly for the smooth…
- 0 votes0 replies0 views
Pennington's Marcenko–Pastur conjecture for multi-layer conjugate kernels
Consider a multi-layer neural network in the linear-width asymptotic regime, and let the activation function be . Assume that … Let the conjugate-kernel spectrum have a limi…
- 0 votes0 replies0 views
Weak feature learning regime for neural tangent kernels
Let denote network depth and denote network width, and consider fully connected ReLU networks in the overparameterized limit where both and are large. Weak feature…