8 problems
- 0 votes0 replies0 views
The stale-loss-value conjecture for single-element FUVAL sampling
In FUVAL, let denote the learned loss-value parameter associated with the th sampled term, and consider single-element sampling, in which one term is sampled at each i…
- 0 votes0 replies0 views
Failure of weak admissibility of ERM in random design
Let be the sample size, let be a function class, and let be a probability distribution. Under the paper's random-design setting, write for empi…
- 0 votes0 replies0 views
Optimality of the ERM error bound with upper isometry remainder
Let be the sample size, let be a function class, and let be a probability distribution. Write for the empirical risk minimizer,…
- 0 votes0 replies0 views
Catalyst acceleration conjecture for local polynomial interpolation-based gradient descent
Catalyst performance conjecture. Catalyst approaches would perform better for other function classes and parameter regimes.
- 0 votes0 replies1 view
The overparametrization hypothesis on optimization of empirical risk
Overparametrization hypothesis. Highly overparametrized models should be easy to optimize despite the empirical risk being generally highly non-convex. This is an informal hypothes…
- 0 votes0 replies1 view
Conjecture on improving the dimension scaling of the lower bound
The matrix is a positive definite matrix indexed by multi-indices in with total degree at most , and the paper derives a lower bound on…
- 0 votes0 replies0 views
Conjecture on variance-reduced FedAc for distributed empirical risk minimization
Consider the distributed empirical risk minimization (ERM) setting, in which a fixed finite collection of objectives is optimized, and let FedAc denote the federated accelerated st…
- 0 votes0 replies0 views
Conjecture on relaxing the technical conditions for boundedness
Theorem concerns conditions ensuring that the relevant system of equations has a unique and bounded solution. The paper does not specify the technical conditions in the conjectural…