Conjectured universally tight lower bound for personalized federated bandits

Let MM clients play a multi-armed bandit for TT time slots. For client mm, let k,mk'_{*,m} denote its optimal arm, let Xk,mX'_{k,m} denote the reward distribution of arm kk for client mm, and let Tk,mT_{k,m} be the expected number of pulls of arm kk by client mm. Write [M]={1,,M}[M]=\{1,\ldots,M\}, and define

β=α+1αM,γ=1αM,η=(β2+(M1)γ2)12.\beta=\alpha+\frac{1-\alpha}{M},\qquad \gamma=\frac{1-\alpha}{M},\qquad \eta=\left(\beta^2+(M-1)\gamma^2\right)^{\frac{1}{2}}.

For distributions P,QP,Q, let kl(P,Q)\mathrm{kl}(P,Q) denote their Kullback–Leibler divergence. Conjectured lower-bound constraint. For any consistent algorithm Π\Pi, as TT\to\infty, for every m[M]m\in[M] and every arm kk,mk\neq k'_{*,m},

β2Tk,m+n:nm,k,nkγ2Tk,nη2kl(Xk,m,Xk,m,m)log(T).\frac{\beta^2}{T_{k,m}}+\sum_{n: n\neq m,\, k'_{*,n}\neq k}\frac{\gamma^2}{T_{k,n}}\leq \frac{\eta^2\mathrm{kl}(X'_{k,m},X'_{k'_{*,m},m})}{\log(T)}.

This conjecture is proposed as the missing universally tight lower-bound characterization for all values of α\alpha in personalized federated multi-armed bandits. The preceding lower-bound results establish related constraints but do not determine the precise dependence on α\alpha; characterizing that dependence remains open.

Sources & referencesView supporting material

Primary source

Chengshuai Shi, Cong Shen and Jing Yang, “Federated Multi-armed Bandits with Personalization”, arXiv:2102.13101 (2021).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.