4 citations · 14 across the 13 of their papers we have counts for
6 papers · 1 filter
Using Large Language Models for the Interpretation of Building Regulations
Stefan Fuchs, Michael Witbrock, Johannes Dimyadi +1
Compliance checking is an essential part of a construction project. The recent rapid uptake of building information models (BIM) in the construction industry has created more oppor…
Teaching Smaller Language Models To Generalise To Unseen Compositional Questions
Tim Hartill, Neset Tan, Michael Witbrock +1
We equip a smaller Language Model to generalise to answering challenging compositional questions that have not been seen in training. To do so we propose a combination of multitask…
Answering Unseen Questions With Smaller Language Models Using Rationale Generation and Dense Retrieval
Tim Hartill, Diana Benavides-Prado, Michael Witbrock +1
When provided with sufficient explanatory context, smaller Language Models have been shown to exhibit strong reasoning ability on challenging short-answer question-answering tasks…
Neuromodulation Gated Transformer
Kobe Knowles, Joshua Bensemann, Diana Benavides-Prado +4
We introduce a novel architecture, the Neuromodulation Gated Transformer (NGT), which is a simple implementation of neuromodulation in transformers via a multiplicative effect. We…
Input-length-shortening and text generation via attention values
Neşet Özkan Tan, Alex Yuxuan Peng, Joshua Bensemann +4
Identifying words that impact a task's performance more than others is a challenge in natural language processing. Transformers models have recently addressed this issue by incorpo…
Semantic Construction Grammar: Bridging the NL / Logic Divide
Dave Schneider, Michael Witbrock
In this paper, we discuss Semantic Construction Grammar (SCG), a system developed over the past several years to facilitate translation between natural language and logical represe…