The Predictive-Causal Gap: An Impossibility Theorem and Large-Scale Neural Evidence

Kejun Liu

We report a systematic failure mode in predictive representation learning. Across 2695 neural network configurations trained to predict linear-Gaussian dynamics, the optimal encode…