Non-singularity of the reduced Information Bottleneck operator

From papers

Let BAβBA_\beta be the Information Bottleneck operator in log-decoder coordinates (logp(yx^),logp(x^))(\log p(y|\hat{x}),\log p(\hat{x})), and let Dlogp(yx^),logp(x^)BAβD_{\log p(y|\hat{x}),\log p(\hat{x})}BA_\beta denote its Jacobian at a solution of the IB beta ODE. A reduced IB root is an IB root represented using its effective cardinality.

Non-singularity conjecture. The Jacobian matrix

IDlogp(yx^),logp(x^)BAβI-D_{\log p(y|\hat{x}),\log p(\hat{x})}BA_\beta

at the IB beta ODE is non-singular at reduced IB roots whenever it is well-defined, except perhaps at points of bifurcation.

This conjecture is motivated by the corresponding result for the rate-distortion Blahut–Arimoto operator after reduction to a root of finite support. Its status is not established in the supplied source; possible failure at bifurcation points is explicitly left open.

Progress summary

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Sources & referencesView supporting material

Primary source

Shlomi Agmon, “The Information Bottleneck's Ordinary Differential Equation: First-Order Root-Tracking for the IB”, arXiv:2306.09790 (2023).

Solutions 0

No solutions have been posted yet.