The asymptotic-bias dichotomy for maximum likelihood estimation of structured anomalies

Let AA be an anomaly in an anomaly family S\mathcal{S}, let XASDS(A,μ)\mathbf{X} \sim \operatorname{ASD}_{\mathcal{S}}(A,\mu), and let A^S\widehat{A}_{\mathcal{S}} be the maximum likelihood estimator. Write S˘(A)\breve{\mathcal{S}}(A) for the sets in S\mathcal{S} containing AA, and let μdetect\mu_{\textnormal{detect}} denote the detection threshold.

Asymptotic-bias dichotomy. The technical condition in the unbiasedness theorem should be replaceable by μμdetect\mu \geq \mu_{\textnormal{detect}}. Under this condition, the MLE is asymptotically biased if and only if S˘(A)|\breve{\mathcal{S}}(A)| is exponential in nn; equivalently,

limnBias(A^S/n)>0\lim_{n\to\infty} \textnormal{Bias}(|\widehat{A}_{\mathcal{S}}|/n)>0

if S˘(A)|\breve{\mathcal{S}}(A)| is exponential in nn, and

limnBias(A^S/n)=0\lim_{n\to\infty} \textnormal{Bias}(|\widehat{A}_{\mathcal{S}}|/n)=0

otherwise.

The conjecture asserts that the two established results—zero asymptotic bias when the number of sets containing the anomaly is sub-exponential, and positive asymptotic bias for the unstructured family—describe the only possible asymptotic bias values. The proposed relaxation from the theorem's technical assumptions to the detection condition, and the general dichotomy, remain unproved.

Sources & referencesView supporting material

Primary source

Uthsav Chitra, Kimberly Ding, Jasper C. H. Lee and Benjamin J. Raphael, “Quantifying and Reducing Bias in Maximum Likelihood Estimation of Structured Anomalies”, arXiv:2007.07878 (2021).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.