The improved sample-independent MGF bound for binomial KL divergence
The improved sample-independent MGF bound for binomial KL divergence
For a binomial experiment with sample size , success probability , empirical proportion , and moment-generating-function parameter , define the binary Kullback–Leibler divergence by
The improved binomial MGF conjecture. The function
is a sample-independent upper bound for the MGF of the binomial KL divergence; equivalently, for every positive integer , , and ,
where . This would improve the existing bound and remain compatible with the asymptotic bound , which is not valid uniformly for all finite samples.
Sources & referencesView supporting material
Primary source
Rohit Agrawal, “Finite-Sample Concentration of the Multinomial in Relative Entropy”, arXiv:1904.02291 (2020).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
Sign in to submit a solution.
No solutions have been posted yet.