Non-singularity of the reduced Information Bottleneck operator
Let be the Information Bottleneck operator in log-decoder coordinates , and let denote its Jacobian at a solution of the IB beta ODE. A reduced IB root is an IB root represented using its effective cardinality.
Non-singularity conjecture. The Jacobian matrix
at the IB beta ODE is non-singular at reduced IB roots whenever it is well-defined, except perhaps at points of bifurcation.
This conjecture is motivated by the corresponding result for the rate-distortion Blahut–Arimoto operator after reduction to a root of finite support. Its status is not established in the supplied source; possible failure at bifurcation points is explicitly left open.
References
Primary source
Shlomi Agmon, “The Information Bottleneck's Ordinary Differential Equation: First-Order Root-Tracking for the IB”, arXiv:2306.09790 (2023).
Progress summary
Nothing recorded yet. Refresh searches the literature and the public web for attempts on this problem, and writes the first summary here.
Solutions 0
No solutions have been posted yet.