Conjectured universally tight lower bound for personalized federated bandits

About 5 years old · traced to

Let MM clients play a multi-armed bandit for TT time slots. For client mm, let k∗,m′k'_{*,m} denote its optimal arm, let Xk,m′X'_{k,m} denote the reward distribution of arm kk for client mm, and let Tk,mT_{k,m} be the expected number of pulls of arm kk by client mm. Write [M]={1,…,M}[M]=\{1,\ldots,M\}, and define

β=α+1−αM,γ=1−αM,η=(β2+(M−1)γ2)12.\beta=\alpha+\frac{1-\alpha}{M},\qquad \gamma=\frac{1-\alpha}{M},\qquad \eta=\left(\beta^2+(M-1)\gamma^2\right)^{\frac{1}{2}}.

For distributions P,QP,Q, let kl(P,Q)\mathrm{kl}(P,Q) denote their Kullback–Leibler divergence. Conjectured lower-bound constraint. For any consistent algorithm Π\Pi, as T→∞T\to\infty, for every m∈[M]m\in[M] and every arm k≠k∗,m′k\neq k'_{*,m},

β2Tk,m+∑n:n≠m, k∗,n′≠kγ2Tk,n≤η2kl(Xk,m′,Xk∗,m′,m′)log⁡(T).\frac{\beta^2}{T_{k,m}}+\sum_{n: n\neq m,\, k'_{*,n}\neq k}\frac{\gamma^2}{T_{k,n}}\leq \frac{\eta^2\mathrm{kl}(X'_{k,m},X'_{k'_{*,m},m})}{\log(T)}.

This conjecture is proposed as the missing universally tight lower-bound characterization for all values of α\alpha in personalized federated multi-armed bandits. The preceding lower-bound results establish related constraints but do not determine the precise dependence on α\alpha; characterizing that dependence remains open.

References

Primary source

Chengshuai Shi, Cong Shen and Jing Yang, “Federated Multi-armed Bandits with Personalization”, arXiv:2102.13101 (2021).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.