2 papers
stat.ML2026
Surprisal-Rényi Free Energy
Shion Matsumoto, Raul Castillo, Benjamin Prada +1
The forward and reverse Kullback-Leibler (KL) divergences arise as limiting objectives in learning and inference yet induce markedly different inductive biases that cannot be expla…
cs.LG2025
Bridging Predictive Coding and MDL: A Two-Part Code Framework for Deep Learning
Benjamin Prada, Shion Matsumoto, Abdul Malik Zekri +1
We present the first theoretical framework that connects predictive coding (PC), a biologically inspired local learning rule, with the minimum description length (MDL) principle in…