3 papers
stat.ML2026
Surprisal-Rényi Free Energy
Shion Matsumoto, Raul Castillo, Benjamin Prada +1
The forward and reverse Kullback-Leibler (KL) divergences arise as limiting objectives in learning and inference yet induce markedly different inductive biases that cannot be expla…
cs.CC2025
Realizable Circuit Complexity: Embedding Computation in Space-Time
Benjamin Prada, Ankur Mali
Classical circuit complexity characterizes parallel computation in purely combinatorial terms, ignoring the physical constraints that govern real hardware. The standard classes $\m…
cs.LG2025
Bridging Predictive Coding and MDL: A Two-Part Code Framework for Deep Learning
Benjamin Prada, Shion Matsumoto, Abdul Malik Zekri +1
We present the first theoretical framework that connects predictive coding (PC), a biologically inspired local learning rule, with the minimum description length (MDL) principle in…