Non-singularity of the reduced Information Bottleneck operator

About 3 years old · traced to

Let BAβBA_\beta be the Information Bottleneck operator in log-decoder coordinates (log⁡p(y∣x^),log⁡p(x^))(\log p(y|\hat{x}),\log p(\hat{x})), and let Dlog⁡p(y∣x^),log⁡p(x^)BAβD_{\log p(y|\hat{x}),\log p(\hat{x})}BA_\beta denote its Jacobian at a solution of the IB beta ODE. A reduced IB root is an IB root represented using its effective cardinality.

Non-singularity conjecture. The Jacobian matrix

I−Dlog⁡p(y∣x^),log⁡p(x^)BAβI-D_{\log p(y|\hat{x}),\log p(\hat{x})}BA_\beta

at the IB beta ODE is non-singular at reduced IB roots whenever it is well-defined, except perhaps at points of bifurcation.

This conjecture is motivated by the corresponding result for the rate-distortion Blahut–Arimoto operator after reduction to a root of finite support. Its status is not established in the supplied source; possible failure at bifurcation points is explicitly left open.

References

Primary source

Shlomi Agmon, “The Information Bottleneck's Ordinary Differential Equation: First-Order Root-Tracking for the IB”, arXiv:2306.09790 (2023).

Progress summary

Never refreshed

Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.

Solutions 0

No solutions have been posted yet.