Neuronal Attention Circuit (NAC) for Representation Learning

Waleed Razzaq, Izis Kanjaraway, Yun-Bo Zhao

Attention improves representation learning over RNNs, but its discrete nature limits continuous-time (CT) modeling. We introduce Neuronal Attention Circuit (NAC), a novel, biologic…