Monotonicity conjecture for the optimal grouped MSE constant

From papers

Let Δk\Delta_k denote the optimal asymptotic MSE constant within the generalized grouping (GG) family for groups of size kk. Monotonicity conjecture.

ΔkΔk1for all k2,\Delta_k \leq \Delta_{k-1}\quad\text{for all }k\geq 2,

i.e., the optimal asymptotic MSE constant within the GG family is non-increasing in kk. The conjecture is strongly supported by the numerical evidence and examples described in the paper, but a general proof remains open.

Progress summary

Open

The conjecture remains open, with numerical experiments supporting the claim that larger groups improve the estimator.

A 2026 paper on grouped reverse importance sampling proposes that the optimal asymptotic MSE constant is non-increasing with group size, namely ΔkΔk1\Delta_k \leq \Delta_{k-1} for k2k \geq 2. It presents this as Conjecture 1 and leaves a general proof unresolved.

Known results

The paper reports strong numerical support, including a decrease from approximately 0.08070.0807 at k=1k=1 to 0.01440.0144 at k=10k=10, an 82%82\% reduction with diminishing returns. For power-law energies U(x)=xγU(x)=|x|^\gamma, the resulting Gamma representation is suggested as a possible route to a proof, but no argument is given.

Current status (as of August 2026): The conjecture is supported numerically but has no published or publicly verified general proof, counterexample, or claimed resolution.

Sources
Sources & referencesView supporting material

Primary source

Neri Merhav, “Grouped Reverse Importance Sampling for the Partition Function”, arXiv:2606.26748 (2026).

Solutions 1

Proof

The unrestricted optimization has zero infimum and generally no minimum; the meaningful fixed-Gaussian monotonicity statement is false.

Use the definitions in Neri Merhav, Grouped Reverse Importance Sampling for the Partition Function, arXiv:2606.26748, Remark 2, equations (22), (24), and (30), and Conjecture 1. Let β>0\beta>0, let U0U\geq0, and let νk\nu_k be the group-energy counting measure or density of states. Assume

Ck=0eβudνk(u)=Z(β)k(0,).C_k=\int_0^\infty e^{-\beta u}\,d\nu_k(u) =Z(\beta)^k\in(0,\infty).

The generalized-Gaussian family and its objective are

mα,s(u)=exp ⁣(uα2s),α>1,s>0,Qk(m)=Ckm(u)2eβudνk(u)(m(u)dνk(u))2,Vk(m)=Qk(m)1k.\begin{aligned} m_{\alpha,s}(u) &=\exp\!\left(-\frac{u^\alpha}{2s}\right), &&\alpha>1,\quad s>0,\\ Q_k(m) &=\frac{ C_k\displaystyle\int m(u)^2e^{\beta u}\,d\nu_k(u) }{ \left(\displaystyle\int m(u)\,d\nu_k(u)\right)^2 },\\ V_k(m)&=\frac{Q_k(m)-1}{k}. \end{aligned}

1. Universal collapse of the unrestricted optimum

Cauchy–Schwarz gives Qk(m)1Q_k(m)\geq1, with equality precisely when m(u)=ceβum(u)=c e^{-\beta u} almost everywhere. Fix s=(2β)1s=(2\beta)^{-1} and let α1\alpha\downarrow1. Set

I1(α)=eβuαdνk(u),I2(α)=e2βuα+βudνk(u).I_1(\alpha)=\int e^{-\beta u^\alpha}\,d\nu_k(u), \qquad I_2(\alpha)=\int e^{-2\beta u^\alpha+\beta u}\,d\nu_k(u).

Since uuα1u-u^\alpha\leq1 for u0u\geq0 and α>1\alpha>1,

eβuαeβeβu,e2βuα+βue2βeβu.e^{-\beta u^\alpha}\leq e^\beta e^{-\beta u}, \qquad e^{-2\beta u^\alpha+\beta u} \leq e^{2\beta}e^{-\beta u}.

Dominated convergence consequently yields

I1(α),I2(α)Ck,Qk(mα,(2β)1)=CkI2(α)I1(α)21.I_1(\alpha),I_2(\alpha)\longrightarrow C_k, \qquad Q_k(m_{\alpha,(2\beta)^{-1}}) =\frac{C_kI_2(\alpha)}{I_1(\alpha)^2} \longrightarrow1.

Therefore, for every group size,

infα>1,s>0Vk(mα,s)=0(k1).\boxed{ \inf_{\alpha>1,\,s>0}V_k(m_{\alpha,s})=0 \qquad(k\geq1). }

Moreover, if νk\nu_k is supported on at least three distinct energies, equality cannot occur: it would require

uα2sβu=constant\frac{u^\alpha}{2s}-\beta u=\text{constant}

on the support, although the left-hand side is strictly convex and can take any fixed value at no more than two points. Hence the minimum in the source's equation (24) does not exist. This includes its own example U(x)=xU(x)=|x| on R\mathbb R.

2. An explicit three-state boundary certificate

Take the source-admissible discrete system

X={0,1,2},U(j)=j,β=log2,Z(β)=74.\mathcal X=\{0,1,2\}, \qquad U(j)=j, \qquad\beta=\log2, \qquad Z(\beta)=\frac74.

For n1n\geq1, choose

αn=log2 ⁣(2+log2 ⁣(1+1n))>1,s=12log2.\alpha_n =\log_2\!\left(2+\log_2\!\left(1+\frac1n\right)\right)>1, \qquad s=\frac1{2\log2}.

Then the one-sample weights are

(mn(0),mn(1),mn(2))=(1,12,n4(n+1)),\left(m_n(0),m_n(1),m_n(2)\right) =\left(1,\frac12,\frac{n}{4(n+1)}\right),

and exact rational arithmetic gives

V1(mn)=6(7n+6)2>0,V1(mn)0.V_1(m_n)=\frac{6}{(7n+6)^2}>0, \qquad V_1(m_n)\longrightarrow0.

Equality would require weights proportional to (1,1/2,1/4)(1,1/2,1/4). The values at energies 00 and 11 force (2s)1=log2(2s)^{-1}=\log2, while the value at energy 22 then forces α=1\alpha=1, which is excluded. Thus the infimum is zero but the minimum is absent.

3. Strict reversal for the fixed Gaussian family

The source's numerical Table 1 fixes α=2\alpha=2 and optimizes only ss. For this distinct substantive interpretation, write

Δk(2)=infs>0Vk(m2,s),t=e1/(2s)(0,1).\Delta_k^{(2)}=\inf_{s>0}V_k(m_{2,s}), \qquad t=e^{-1/(2s)}\in(0,1).

For the same three-state system,

M1(t)=1+t+t4,N1(t)=1+2t2+4t8,V1(t)=74N1(t)M1(t)21.\begin{aligned} M_1(t)&=1+t+t^4,\\ N_1(t)&=1+2t^2+4t^8,\\ V_1(t)&=\frac74\frac{N_1(t)}{M_1(t)^2}-1. \end{aligned}

At t=7/10t=7/10,

Δ1(2)10454806376398801<7250.\Delta_1^{(2)} \leq\frac{10454806}{376398801} <\frac7{250}.

For two samples, the energy multiplicities are (1,2,3,2,1)(1,2,3,2,1), so

M2(t)=1+2t+3t4+2t9+t16,N2(t)=1+4t2+12t8+16t18+16t32,V2(t)=12(4916N2(t)M2(t)21).\begin{aligned} M_2(t)&=1+2t+3t^4+2t^9+t^{16},\\ N_2(t)&=1+4t^2+12t^8+16t^{18}+16t^{32},\\ V_2(t)&=\frac12\left( \frac{49}{16}\frac{N_2(t)}{M_2(t)^2}-1 \right). \end{aligned}

In fact,

V2(t)7250=F(t)4000M2(t)2,V_2(t)-\frac7{250} =\frac{F(t)}{4000M_2(t)^2},

where

F(t)=95888t328448t2512672t20+89552t188448t174224t1625344t1316896t108448t9+54492t825344t512672t4+16052t28448t+4013.\begin{aligned} F(t) ={}&95888t^{32}-8448t^{25}-12672t^{20}+89552t^{18} -8448t^{17}-4224t^{16}\\ &-25344t^{13}-16896t^{10}-8448t^9+54492t^8 -25344t^5-12672t^4\\ &+16052t^2-8448t+4013. \end{aligned}

To certify positivity globally, write F(t)=i=032aitiF(t)=\sum_{i=0}^{32}a_it^i. On each interval [j/8,(j+1)/8][j/8,(j+1)/8], use the Bernstein expansion

F ⁣(j+y8)==032bj,(32)y(1y)32,0y1,F\!\left(\frac{j+y}{8}\right) =\sum_{\ell=0}^{32} b_{j,\ell}\binom{32}{\ell}y^\ell(1-y)^{32-\ell}, \qquad 0\leq y\leq1,

whose coefficients are explicitly

bj,=r=0(r)(32r)i=r32ai(ir)jir8i.b_{j,\ell} =\sum_{r=0}^{\ell} \frac{\binom{\ell}{r}}{\binom{32}{r}} \sum_{i=r}^{32}a_i\binom{i}{r}\frac{j^{i-r}}{8^i}.

Exact rational evaluation gives

j01234567minbj,>3203>2830>2682>2394>1601>312>12>2639.\begin{array}{c|rrrrrrrr} j&0&1&2&3&4&5&6&7\\ \hline \min_{\ell}b_{j,\ell} &>3203&>2830&>2682&>2394&>1601&>312&>12&>2639. \end{array}

Since the Bernstein basis is nonnegative and sums to 11, it follows that F(t)>12F(t)>12 throughout [0,1][0,1]. Also M2(t)9M_2(t)\leq9. Therefore

Δ2(2)7250+127000>7250>Δ1(2).\boxed{ \Delta_2^{(2)} \geq\frac7{250}+\frac1{27000} >\frac7{250} >\Delta_1^{(2)}. }

Thus the unrestricted infimum formulation is identically zero, the literal minimum formulation is generally undefined, and the practically motivated fixed-Gaussian monotonicity formulation is false.

0 endorsements
Shivam Patel · · edited