activity
20212024
most citedInput-length-shortening and text generation via attention values

2 citations · 4 across the 7 of their papers we have counts for

collaborators

7 papers

cs.AI2024

Is GPT-4 conscious?

Izak Tait, Joshua Bensemann, Ziqi Wang

GPT-4 is often heralded as a leading commercial AI offering, sparking debates over its potential as a steppingstone toward artificial general intelligence. But does it possess cons…

cs.CL2023

Do Smaller Language Models Answer Contextualised Questions Through Memorisation Or Generalisation?

Tim Hartill, Joshua Bensemann, Michael Witbrock +1

A distinction is often drawn between a model's ability to predict a label for an evaluation sample that is directly memorised from highly similar training samples versus an ability…

cs.CL2023★ 1 cited

Challenges in Annotating Datasets to Quantify Bias in Under-represented Society

Vithya Yogarajan, Gillian Dobbie, Timothy Pistotti +2

Recent advances in artificial intelligence, including the development of highly sophisticated large language models (LLM), have proven beneficial in many real-world applications. H…

cs.CL2023

Neuromodulation Gated Transformer

Kobe Knowles, Joshua Bensemann, Diana Benavides-Prado +4

We introduce a novel architecture, the Neuromodulation Gated Transformer (NGT), which is a simple implementation of neuromodulation in transformers via a multiplicative effect. We…

cs.CL2023★ 2 cited

Input-length-shortening and text generation via attention values

Neşet Özkan Tan, Alex Yuxuan Peng, Joshua Bensemann +4

Identifying words that impact a task's performance more than others is a challenge in natural language processing. Transformers models have recently addressed this issue by incorpo…

cs.CL2022

AbductionRules: Training Transformers to Explain Unexpected Inputs

Nathan Young, Qiming Bao, Joshua Bensemann +1

Transformers have recently been shown to be capable of reliably performing logical reasoning over facts and rules expressed in natural language, but abductive reasoning - inference…

q-bio.NC2021★ 1 cited

Relating Blindsight and AI: A Review

Joshua Bensemann, Qiming Bao, Gaël Gendron +2

Processes occurring in brains, a.k.a. biological neural networks, can and have been modeled within artificial neural network architectures. Due to this, we have conducted a review…