58 citations · 394 across the 35 of their papers we have counts for
4 papers · 1 filter
Brain-inspired Computational Intelligence via Predictive Coding
Tommaso Salvatori, Ankur Mali, Christopher L. Buckley +4
Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The majority of results in AI thus far have been achieved using deep neural networks t…
Understanding Predictive Coding as an Adaptive Trust-Region Method
Francesco Innocenti, Ryan Singh, Christopher L. Buckley
Predictive coding (PC) is a brain-inspired local learning algorithm that has recently been suggested to provide advantages over backpropagation (BP) in biologically relevant scenar…
Attention: Marginal Probability is All You Need?
Ryan Singh, Christopher L. Buckley
Attention mechanisms are a central property of cognitive systems allowing them to selectively deploy cognitive resources in a flexible manner. Attention has been long studied in th…
Pretraining Language Models with Human Preferences
Tomasz Korbak, Kejian Shi, Angelica Chen +5
Language models (LMs) are pretrained to imitate internet text, including content that would violate human preferences if generated by an LM: falsehoods, offensive comments, persona…