31 citations · 45 across the 10 of their papers we have counts for
3 papers · 1 filter
Neuromodulation Gated Transformer
Kobe Knowles, Joshua Bensemann, Diana Benavides-Prado +4
We introduce a novel architecture, the Neuromodulation Gated Transformer (NGT), which is a simple implementation of neuromodulation in transformers via a multiplicative effect. We…
Large Language Models Are Not Strong Abstract Reasoners
Gaël Gendron, Qiming Bao, Michael Witbrock +1
Large Language Models have shown tremendous performance on a large variety of natural language processing tasks, ranging from text comprehension to common sense reasoning. However,…
Effectiveness of Debiasing Techniques: An Indigenous Qualitative Analysis
Vithya Yogarajan, Gillian Dobbie, Henry Gouk
An indigenous perspective on the effectiveness of debiasing techniques for pre-trained language models (PLMs) is presented in this paper. The current techniques used to measure and…