2 citations · 3 across the 3 of their papers we have counts for
3 papers
Neuromodulation Gated Transformer
Kobe Knowles, Joshua Bensemann, Diana Benavides-Prado +4
We introduce a novel architecture, the Neuromodulation Gated Transformer (NGT), which is a simple implementation of neuromodulation in transformers via a multiplicative effect. We…
Input-length-shortening and text generation via attention values
Neşet Özkan Tan, Alex Yuxuan Peng, Joshua Bensemann +4
Identifying words that impact a task's performance more than others is a challenge in natural language processing. Transformers models have recently addressed this issue by incorpo…
Relating Blindsight and AI: A Review
Joshua Bensemann, Qiming Bao, Gaël Gendron +2
Processes occurring in brains, a.k.a. biological neural networks, can and have been modeled within artificial neural network architectures. Due to this, we have conducted a review…