42 problems
- 0 votes0 replies0 views
Belief propagation conjecture for Bayes-optimal matrix factorization
Consider the belief propagation equations for the matrix factorization model and their fixed points. Bayes-optimal inference refers to inference under the true generative distribut…
- 0 votes0 replies0 views
Conjectured improvement of the log-concave concentration condition
Conjectured improvement. The condition could be improved to
- 0 votes0 replies0 views
Necessity of the prior-mean range condition for posterior mean error bounds
Let be the prior mean and let be a prior covariance factor appearing in the finite-dimensional linear Gaussian inverse problem,…
- 0 votes0 replies0 views
Convergence conjecture for space-filling A-OTF training data
The A-OTF method uses training data consisting of input-output samples for learning an approximation to a transport map, and its training objective is the optimization problem in e…
- 0 votes0 replies0 views
The hyper-parameter conjecture for Regularized Top- sparsification
Let denote the accumulated gradient associated with coordinate at iteration , and let be the exponent governing the prior's dependence on…
- 0 votes0 replies0 views
High-SNR Bayesian advantage conjecture for continuous non-Gaussian priors
High-SNR Bayesian advantage conjecture. As in the case of discrete priors, the non-rotationally invariant nature of the prior should be exploitable to construct a Bayesian estimato…
- 0 votes0 replies0 views
Posterior-sampling conjecture for gradient descent in quadratic neural networks
Consider the noiseless () one-hidden-layer neural network with quadratic activation and a target function matching this architecture. Let randomly initialized gradient de…
- 0 votes0 replies0 views
Meta-consistency of inference schemes for metastable systems
Metastable systems exhibit behaviour that appears stable on some time scale but becomes unstable on longer time scales. In this setting, an inference scheme is metaconsistent when…
- 0 votes0 replies0 views
The AMP characterization of the algorithmic hard phase
Consider a high-dimensional Bayesian inference problem for which approximate message passing (AMP) has a state evolution and a Bayes-optimal solution given by the posterior mean es…
- 0 votes0 replies0 views
Conjecture on prior-dependent mixture approximations in high-dimensional Bernstein–von Mises theory
Prior-dependent mixture conjecture. The approximating distribution of the posterior is conjectured to be a mixture that depends on the prior distribution.
- 0 votes0 replies0 views
Conjecture that the PINN posterior beats the nonparametric minimax rate
PINN posterior rate conjecture. We conjecture that the PINN posterior distribution actually converges faster than the nonparametric minimax rate.
- 0 votes0 replies0 views
Extension of heavy-tailed posterior contraction results to standard posteriors
Let denote the power to which the likelihood is raised in the posterior, with standard posteriors corresponding to . Standard-posterior conjecture. The theoretic…
- 0 votes0 replies0 views
All-orders posterior linearity for deep weakly nonlinear networks
All-orders posterior-linearity conjecture. The predictive posterior of the deep nonlinear network coincides with the posterior of a deep linear network on the transformed data…
- 0 votes0 replies0 views
Large-data small-noise Gaussian approximation for the nonlinear posterior
Let denote the finite-dimensional non-Gaussian measure arising in the decomposition of the conditioned Gaussian measure, with observation data an…
- 0 votes0 replies0 views
Nonlinear hypotheses are susceptible to false confidence
Nonlinearity conjecture. All non-linear hypotheses about have at least a mild case of false confidence.
- 0 votes0 replies0 views
Universality of low-degree Bayes-optimal matrix denoising beyond orthogonal invariance
Universality conjecture. The optimality of the low-degree polynomial estimators holds beyond strictly orthogonally invariant priors; in particular, this universality phenomenon inc…
- 0 votes0 replies0 views
The Bayes–Unexpectedness correspondence conjecture
Bayes–Unexpectedness correspondence conjecture. Bayes’ rule is a specific instantiation of a more general template captured in ST by Unexpectedness. This conjecture proposes a theo…
- 0 votes0 replies0 views
Optimality conjecture for rotation-invariant estimators in extensive-rank matrix factorization
Optimality conjecture. The analytical formulas for rotation-invariant estimators are optimal in the large-dimension limit, in the sense that they minimize the average mean-square e…
- 0 votes0 replies0 views
Fourth-order Laplace approximation conjecture for skewed posterior distributions
A skewed posterior approximation may replace the Gaussian density in the symmetric component with a density obtained by extending the Laplace method to fourth order. Fourth-order s…
- 0 votes0 replies0 views
Exactness conjecture for replica-based predictions
Consider the paper's Bayesian-optimal inference setting, equivalently statistical-mechanical models on the Nishimori line, in the asymptotic limit , and let the paper's…
- 0 votes0 replies1 view
Universality conjecture for the noise eigenvalue ensemble
Let be the prescribed limiting noise-eigenvalue distribution, and consider the simpler noise ensemble in which the eigenvalues are drawn independently and identic…
- 0 votes0 replies0 views
BAMP Bayes-optimality conjecture
Let BAMP denote the novel approximate message passing algorithm using the pre-processed data matrix and its multi-stage state-evolution recursion, and let…
- 0 votes0 replies0 views
AMP optimality among polynomial-time algorithms
Consider a high-dimensional Bayesian estimation problem in which approximate message passing (AMP) has a state-evolution characterization and achieves Bayes-optimal performance for…
- 0 votes0 replies0 views
Conjecture that mismatched Bayes convergence holds without Wigner regularization
Let be the mismatched posterior, let be the planted signal, and let be the function defined by … Here…
- 0 votes0 replies1 view
Approximate Bayesian inversions in probabilistic quasi-Borel spaces
Let be the category of quasi-Borel spaces, and let denote the probabilistic construction. For objects and , a morphis…