3 papers
cs.AI2024
Hybrid Recurrent Models Support Emergent Descriptions for Hierarchical Planning and Control
Poppy Collis, Ryan Singh, Paul F Kinghorn +1
An open problem in artificial intelligence is how systems can flexibly learn discrete abstractions that are useful for solving inherently continuous problems. Previous work has dem…
cs.NE2023
Understanding Predictive Coding as an Adaptive Trust-Region Method
Francesco Innocenti, Ryan Singh, Christopher L. Buckley
Predictive coding (PC) is a brain-inspired local learning algorithm that has recently been suggested to provide advantages over backpropagation (BP) in biologically relevant scenar…
cs.LG2023
Attention: Marginal Probability is All You Need?
Ryan Singh, Christopher L. Buckley
Attention mechanisms are a central property of cognitive systems allowing them to selectively deploy cognitive resources in a flexible manner. Attention has been long studied in th…