2 problems

Let $a_t$ be an independent and identically distributed process, and let $r_i$ follow either a linear regression model with white noise or a weighted random-walk model. Let $\pi_5$…

Let $\widehat{\pi}$ be an arbitrary adaptive policy, and let $\mathcal{R}_n(\widehat{\pi})$ denote its regret after $n$ time points. Lower-bound conjecture. For an arbitrary adapti…