1 citations · 1 across the 4 of their papers we have counts for
5 papers
SANTA++: Sampling Attention through Representative Keys
Kyle Lee, Christian Z. Pratt, Ruoyu Fang +4
Attention often concentrates on a small subset of tokens in the context, but which subset matters changes from one query to the next. To exploit this changing structure, we introdu…
Extreme-Scale Ising Machines with Cluster Mean-Field Theory
Xiuqi Zhang, Shuvro Chowdhury, Shaila Niazi +3
Scaling analog and digital Ising machines to larger problems requires overcoming finite device capacity and the cost of communication between devices. We present cluster mean-field…
Metastable Dynamical Computing with Energy Landscapes: A Primer
Christian Z. Pratt, Kyle J. Ray, James P. Crutchfield
Smartphones, laptops, and data centers are CMOS-based technologies that ushered our world into the information age of the 21st century. Despite their advantages for scalable comput…
Controlled Erasure as a Building Block for Universal Thermodynamically-Robust Superconducting Computing
Christian Z. Pratt, Kyle J. Ray, James P. Crutchfield
Reducing the energy inefficiency of conventional CMOS-based computing devices -- which rely on logically irreversible gates to process information -- remains both a fundamental eng…
Extracting Equations of Motion from Superconducting Circuits
Christian Z. Pratt, Kyle J. Ray, James P. Crutchfield
Alternative computing paradigms open the door to exploiting recent innovations in computational hardware to probe the fundamental thermodynamic limits of information processing. On…