24 problems
- 0 votes0 replies1 view
The conjecture that Gaussian flow may get stuck in local minima while CBO is more robust
Let GF denote the Gaussian gradient flow method and CBO the consensus-based optimization method for approximating Gaussian mixture target distributions, with multiple particles use…
- 0 votes0 replies1 view
Conjecture on the variational information matrix in generalized Gaussian mixture models
Let be the variational information matrix at the true parameter . Consider models with unequal component weights or non-identity covariance matrices, and suppose…
- 0 votes0 replies1 view
Convergence of variational Laplace maximizers
Consider the maximizers of the variational-Laplace objective in the exponential-family setting described above, with the normalized objective converging in probability…
- 0 votes0 replies1 view
The variance-offset conjecture for online variational Bayes
Variance-offset conjecture. Variance inflation induced by sequential updates offsets the usual variance underestimation associated with KL-based variational approximations.
- 0 votes0 replies0 views
The target-complexity conjecture for Gaussian mixture variational inference
Let the sampling problem have a target density whose complexity may be measured, for example, by its number of modes, and let the problem dimension be the number of variables in th…
- 0 votes0 replies0 views
Gaussianity of the non-Gaussian posterior component for dense collocation points
Consider the non-Gaussian component of the posterior measure arising in the GP-PDE collocation method, where collocation points impose nonlinear PDE observations. Dense-collocation…
- 0 votes0 replies0 views
Empirical relationship between logistic regression estimates and random-effect variances
Consider the logistic regression model with crossed random effects, with intercept and slope estimates and from…
- 0 votes0 replies0 views
Variational inference as the denoising algorithm of convolutional U-nets
Consider diffusion neural networks for image-generation tasks, in particular U-nets with convolutional layers, and graphical models having locality and invariance structures. U-net…
- 0 votes0 replies0 views
- 0 votes0 replies0 views
- 0 votes0 replies0 views
TAP consistency for spiked matrix models with non-Rademacher priors
Suppose , where and for a distributi…
- 0 votes0 replies0 views
TAP consistency for non-Gaussian Wigner matrices
Let , where is a symmetric random matrix whose off-diagonal elements are independent, have variance , and satisfy some mom…
- 0 votes0 replies0 views
Improved convergence rates for GB-SVGD in the small-data regime
Conjecture on GB-SVGD rates. The convergence rates of GB-SVGD can be improved even in the regime . The paper establishes provably fast convergence guarantees for finite-p…
- 0 votes0 replies0 views
Logarithmic-dimensional convergence of mean-field BBVI
Let BBVI denote black-box variational inference, and let the mean-field variational family be the class of variational distributions whose coordinates are independent. Under mild a…
- 0 votes0 replies0 views
Uniform-in-time mean-field convergence for the Gaussian-Stein particle system
Let evolve according to the finite-particle system defined by the Gaussian-Stein dynamics above, and let the corresponding mean-field limit be the associ…
- 0 votes0 replies0 views
Conjecture on inducing-variable mean-field variational posterior rates for Hawkes processes
Let be a Hawkes process with link functions and parameter satisfying Assumption (ass-psi), and suppose the hierarchical squared exponential Gau…
- 0 votes0 replies1 view
Conjecture on heavier tails and the Hessian mismatch ratio
Let , let be the unique minimum of , and define the local Hessian mismatch ratio ……
- 0 votes0 replies1 view
Conjecture that sampling has the highest variance among unbiased mixtures
Let a stochastic mixture have component family and mixing distribution . Call it unbiased when its mixture density satisfies…
- 0 votes0 replies0 views
Conjecture that sampling arises from a broader class of mixture components
Let be a component family and let be a mixing distribution. Sampling is defined by unbiasedness in the limit of infinitely many compo…
- 0 votes0 replies1 view
Uniform higher-derivative bounds for strong convexity and smoothness of the variational objective
Higher-derivative extension conjecture. A similar result would hold under the assumption of a uniform bound on the derivative of .
- 0 votes0 replies0 views
Higher-order derivative bounds suffice for Gaussian variational inference asymptotics
Higher-order derivative conjecture. Bounds on higher-order derivatives would also suffice in place of the imposed bound on the second derivative.
- 0 votes0 replies0 views
Conjecture that Gumbel-softmax approximation preserves variational Bayes convergence
Gumbel-softmax convergence conjecture. The Gumbel-softmax approximation does not hurt variational Bayes convergence.
- 0 votes0 replies1 view
The conjecture that the TRW bound is a special case of the variational Hölder approach
The TRW bound concerns an upper bound on the log-partition function for graphical models with discrete variables, with known tree weights. The proposed variational approach is base…
- 0 votes0 replies0 views
Consistency of variational approximation for the multi-graph stochastic block model
The multi-graph stochastic block model consists of multiple network layers sharing node class assignments, with layer-specific connection probability matrices; variational approxim…