2 papers
quant-ph2026
Information-Theoretic Scaling Laws of Neural Quantum States
Yiming Lu, Sriram Bharadwaj, Dikshant Rathore +1
We establish an information-theoretic scaling law for generic autoregressive neural quantum states, determined by the middle-cut mutual information of the wavefunction amplitude. B…
cs.CL2025
LM: Mutual Information Scaling Law for Long-Context Language Modeling
Zhuo Chen, Oriol Mayné i Comas, Zhuotao Jin +2
We present a universal theoretical framework for understanding long-context language modeling based on a bipartite mutual information scaling law that we rigorously verify in natur…