38 citations · 159 across the 19 of their papers we have counts for
8 papers · 1 filter
Neural Summarization of Electronic Health Records
Koyena Pal, Seyed Ali Bahrainian, Laura Mercurio +1
Hospital discharge documentation is among the most essential, yet time-consuming documents written by medical practitioners. The objective of this study was to automatically genera…
Stable Anisotropic Regularization
William Rudman, Carsten Eickhoff
Given the success of Large Language Models (LLMs), there has been considerable interest in studying the properties of model activations. The literature overwhelmingly agrees that L…
Language Models Implement Simple Word2Vec-style Vector Arithmetic
Jack Merullo, Carsten Eickhoff, Ellie Pavlick
A primary criticism towards language models (LMs) is their inscrutability. This paper presents evidence that, despite their size and complexity, LMs sometimes exploit a simple vect…
Parameter-efficient Modularised Bias Mitigation via AdapterFusion
Deepak Kumar, Oleg Lesota, George Zerveas +4
Large pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial train…
Linearly Mapping from Image to Text Space
Jack Merullo, Louis Castricato, Carsten Eickhoff +1
The extent to which text-only language models (LMs) learn to represent features of the non-linguistic world is an open question. Prior work has shown that pretrained LMs can be tau…
Pretraining on Interactions for Learning Grounded Affordance Representations
Jack Merullo, Dylan Ebert, Carsten Eickhoff +1
Lexical semantics and cognitive science point to affordances (i.e. the actions that objects support) as critical for understanding and representing nouns and verbs. However, study…