15 problems
- 0 votes0 replies0 views
The optimal-runtime conjecture for stochastic exp-concave optimization
Stochastic exp-concave optimization (SXO) concerns minimizing the population objective from stochastic gradient-oracle queries in dimension , to accuracy . Optimal-run…
- 0 votes0 replies0 views
Necessity of Lipschitz continuity for universality in strongly convex optimization
Consider deterministic strongly convex optimization, where an algorithm is called universal if it achieves the relevant near-optimal convergence rates without prior knowledge of pr…
- 0 votes0 replies0 views
Extension of stochastic OFO analysis to expectation inequality constraints
The stochastic online feedback optimization framework considers agents that may be non-compliant with commands issued by a central controller or multiple local controllers. In the…
- 0 votes0 replies1 view
Optimality of the linearizability coefficient for case A1
Optimality conjecture. When , the coefficient is optimal; equivalently, no higher approximation coefficient is possible for the corresponding o…
- 0 votes0 replies0 views
Instance-dependent weighting can improve schedule-free optimization
The framework uses exponentially increasing weights, corresponding to a constant , and these weights achieve optimal worst-case convergence guarantees. Instance-depende…
- 0 votes0 replies0 views
The arithmetic-complexity lower-bound conjecture for stochastic exp-concave optimization
Arithmetic-complexity conjecture. Without additional assumptions on the data-generating distribution, it is not possible to find an -optimal point using fewer than…
- 0 votes0 replies0 views
Asymptotic optimality of PID controllers without the real-roots assumption
PID controllers are studied under a real-roots assumption on the transfer function, while the experiments include parameter choices that do not satisfy this assumption and neverthe…
- 0 votes0 replies0 views
Extension of the PID regret analysis to underdamped oscillators
The analysis considers PID controllers whose transfer function has real roots, corresponding to an overdamped linear filter; imaginary roots instead correspond to an underdamped os…
- 0 votes0 replies0 views
Quadratic-convexity dichotomy for optimal dual averaging
Let be the constraint set in stochastic or online convex optimization, and define its coordinatewise square by … Call quadratically convex wh…
- 0 votes0 replies0 views
Nontriviality of the regret-bound gap for online control with predictions
The setting is online linear-quadratic tracking with prediction window , horizon , variation budget , and condition number ; the regret bounds above differ by a s…
- 0 votes0 replies0 views
Information and generalization in online algorithms
The algorithms considered use different amounts of information about the hitting-cost function: OBD PLUS uses projection onto different level sets, Weighted Greedy queries gradient…
- 0 votes0 replies0 views
The fundamental logarithmic penalty conjecture for any-time SGD algorithms
Let an any-time algorithm be an SGD algorithm that does not require a priori knowledge of the total number of iterations . Let be the gradient bound and the diameter par…
- 0 votes0 replies0 views
ISSA's suitability conjecture for changing-model online optimization
In online convex optimization, data points arrive in streams and the probabilistic model generating them may change over time, so the optimal point moves during the optim…
- 0 votes0 replies0 views
Conjecture on strengthening theoretical results with multiple gradients per time step
In decentralized online optimization, suppose that agents receive multiple gradients during each time step. Multiple-gradient conjecture. Our theoretical results can be strengthene…
- 0 votes0 replies1 view
Weakening the concavity and convexity assumptions under an exact computational oracle
Assume that, at each time , Assumption (A4) provides an exact computational oracle for the maximizer , and that Assumption (A3) imposes concavity of the fu…