432 citations · 686 across the 12 of their papers we have counts for
12 papers
Language Models Are Capable of Metacognitive Monitoring and Control of Their Internal Activations
Li Ji-An, Hua-Dong Xiong, Robert C. Wilson +2
Large language models (LLMs) can sometimes report the strategies they actually use to solve tasks, yet at other times seem unable to recognize those strategies that govern their be…
Deep Learning without Weight Symmetry
Li Ji-An, Marcus K. Benna
Backpropagation, a foundational algorithm for training artificial neural networks, predominates in contemporary deep learning. Although highly successful, it is widely considered b…
Linking In-context Learning in Transformers to Human Episodic Memory
Li Ji-An, Corey Y. Zhou, Marcus K. Benna +1
Understanding connections between artificial and biological intelligent systems can reveal fundamental principles of general intelligence. While many artificial intelligence models…
Emulating Complex Synapses Using Interlinked Proton Conductors
Lifu Zhang, Ji-An Li, Yang Hu +4
In terms of energy efficiency and computational speed, neuromorphic electronics based on non-volatile memory devices is expected to be one of most promising hardware candidates for…
Computational principles of biological memory
Marcus K. Benna, Stefano Fusi
Memories are stored, retained, and recollected through complex, coupled processes operating on multiple timescales. To understand the computational principles behind these intricat…
De (Baby) Sitter Overlaps
Marcus K. Benna
In this note we employ methods borrowed from spin glass theory to study the phase space structure of fields in an inflating universe. In particular, we compute the overlap distribu…