Product conjecture for Patnaik–Pearson dimension of random matrix products

Let cλc{\lambda} and cϕc{\phi} be regularly varying random variables, with tail exponents calphacalpha and cbetacbeta, respectively. Let AA and BB be random matrices in general position, of dimensions NctimesdN ctimes d and dctimesmd ctimes m, respectively, with NN, dd, and mm all sufficiently large. Suppose that their singular-value decompositions are

A=UAdiag(λ)VAt,B=UBdiag(ϕ)VBt,A=U_A\operatorname{diag}(\boldsymbol{\lambda})V_A^t,\qquad B=U_B\operatorname{diag}(\boldsymbol{\phi})V_B^t,

where the singular values are iid with clambdai\simclambdaclambda_i\simclambda and cphii\simcphicphi_i\simcphi. Considering coperatornamePP(A)coperatorname{PP}(A), coperatornamePP(B)coperatorname{PP}(B), and coperatornamePP(AB)coperatorname{PP}(AB) as random variables, Product conjecture.

1dE(PP(A))1mE(PP(B))1mE(PP(AB))min{1dE(PP(A)),1mE(PP(B))}.\frac{1}{d}\mathbb{E}(\operatorname{PP}(A))\,\frac{1}{m}\mathbb{E}(\operatorname{PP}(B))\leq\frac{1}{m}\mathbb{E}(\operatorname{PP}(AB))\leq\min\left\{\frac{1}{d}\mathbb{E}(\operatorname{PP}(A)),\frac{1}{m}\mathbb{E}(\operatorname{PP}(B))\right\}.

The conjecture predicts that multiplying random matrices combines their normalized intrinsic dimensions multiplicatively as a lower bound, while the product cannot exceed the smaller normalized factor. The source motivates it with numerical experiments and a heuristic based on regularly varying singular values; a rigorous derivation is suggested via free-probability transforms, but no resolution is given.

Sources & referencesView supporting material

Primary source

Tom Hadfield, “Patnaik-Pearson intrinsic dimension for internal representations of neural networks”, arXiv:2606.19268 (2026).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.