8 problems
- 0 votes0 replies1 view
Two-Sided L-BFGS wall-clock efficiency conjecture
Let Two-Sided L-BFGS denote the proposed limited-memory BFGS algorithm using the geometric envelope safeguard, and let standard L-BFGS denote the corresponding metho…
- 0 votes0 replies1 view
Sufficiency of initial gradient descent steps in qNBO
qNBO initialization conjecture. In practice, a few initial gradient descent steps are sufficient, although they are necessary for the theoretical analysis.
- 0 votes0 replies1 view
The classical quasi-Newton steps conjecture for IQN and SLIQN
Classical quasi-Newton steps conjecture. We conjecture that IQN and SLIQN contain the steps of classical quasi-Newton updates.
- 0 votes0 replies1 view
The larger-batch-size conjecture for variance-reduced stochastic quasi-Newton methods
In decentralized stochastic optimization, let gradient and Hessian estimators be constructed using mini-batches in the proposed variance-reduced stochastic second-order methods. La…
- 0 votes0 replies0 views
Rodomanov's faster superlinear convergence conjecture for SR1 and BFGS methods
Let SR1 and BFGS denote the symmetric rank-one and Broyden–Fletcher–Goldfarb–Shanno quasi-Newton methods, respectively. Rodomanov's conjecture. SR1 and BFGS methods might have fast…
- 0 votes0 replies0 views
The error overwrite conjecture for Agg-BFGS
The limited-memory BFGS method with displacement aggregation, denoted texttt{Agg-BFGS}, is applied repeatedly to curvature information over a sequence of iterations. The resulting…
- 0 votes0 replies0 views
BFGS for the unit ball
BFGS for the unit ball. The trial step converges to zero.
- 0 votes0 replies1 view
Stochastic quasi-Newton superiority conjecture over classical BFGS
Let be an invertible matrix and consider stochastic quasi-Newton rules obtained by applying the paper's stochastic reformulation and its basic, parallel, or accelerated s…