1 problem

0 votes0 replies0 views
The implicit-learning-rate conjecture for sign-based compression in adaptive federated optimization
In federated optimization with a small participation rate, let $chat v$ denote the second-moment estimate used by an adaptive method, and consider sign-based compressors that assig…
Conjectureopenfederated-learning gradient-compression nonconvex-optimizationarXiv posted 2 days ago

The implicit-learning-rate conjecture for sign-based compression in adaptive federated optimization