533 citations · 584 across the 21 of their papers we have counts for
1 paper · 2 filters
Zhuo Chen, Oriol Mayné i Comas, Zhuotao Jin +2
We present a universal theoretical framework for understanding long-context language modeling based on a bipartite mutual information scaling law that we rigorously verify in natur…