1.8k citations
Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.
- Turing InstituteGB178 papers
- University of OxfordGB114 papers
- University of WarwickGB102 papers
- Queen Mary University of LondonGB91 papers
- University of CambridgeGB89 papers
- University College LondonGB81 papers
- Imperial College LondonGB60 papers
- University of EdinburghGB54 papers
- University of ManchesterGB30 papers
- University of ExeterGB25 papers
- University of SouthamptonGB20 papers
- Centre National de la Recherche ScientifiqueFR19 papers
27 papers · 1 filter
Learning and Enforcing Context-Sensitive Control for LLMs
Mohammad Albinhassan, Pranava Madhyastha, Mark Law +1
Controlling the output of Large Language Models (LLMs) through context-sensitive constraints has emerged as a promising approach to overcome the limitations of Context-Free Grammar…
Retrieval-augmented reasoning with lean language models
Ryan Sze-Yin Chan, Federico Nanni, Tomas Lazauskas +6
This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG…
Evaluating the Ability of Large Language Models to Reason about Cardinal Directions
Anthony G Cohn, Robert E Blackwell
We investigate the abilities of a representative set of Large language Models (LLMs) to reason about cardinal directions (CDs). To do so, we create two datasets: the first, co-crea…
How Can We Effectively Expand the Vocabulary of LLMs with 0.01GB of Target Language Text?
Atsuki Yamaguchi, Aline Villavicencio, Nikolaos Aletras
Large language models (LLMs) have shown remarkable capabilities in many languages beyond English. Yet, LLMs require more inference steps when generating non-English text due to the…
Mapping 'when'-clauses in Latin American and Caribbean languages: an experiment in subtoken-based typology
Nilo Pedrazzini
Languages can encode temporal subordination lexically, via subordinating conjunctions, and morphologically, by marking the relation on the predicate. Systematic cross-linguistic va…
Cheap Learning: Maximising Performance of Language Models for Social Data Science Using Minimal Data
Leonardo Castro-Gonzalez, Yi-Ling Chung, Hannak Rose Kirk +4
The field of machine learning has recently made significant progress in reducing the requirements for labelled training data when building new models. These `cheaper' learning tech…
Are NLP Models Good at Tracing Thoughts: An Overview of Narrative Understanding
Lixing Zhu, Runcong Zhao, Lin Gui +1
Narrative understanding involves capturing the author's cognitive processes, providing insights into their knowledge, intentions, beliefs, and desires. Although large language mode…
It's About Time: Temporal References in Emergent Communication
Olaf Lipinski, Adam J. Sobey, Federico Cerutti +1
Emergent communication enables agents to develop bespoke languages that improve communication efficiency. Despite the known importance of temporal structure in natural language, th…
Emotion fusion for mental illness detection from social media: A survey
Tianlin Zhang, Kailai Yang, Shaoxiong Ji +1
Mental illnesses are one of the most prevalent public health problems worldwide, which negatively influence people's lives and society's health. With the increasing popularity of s…
Rationalizing Predictions by Adversarial Information Calibration
Lei Sha, Oana-Maria Camburu, Thomas Lukasiewicz
Explaining the predictions of AI models is paramount in safety-critical applications, such as in legal or medical domains. One form of explanation for a prediction is an extractive…
American cultural regions mapped through the lexical analysis of social media
Thomas Louf, Bruno Gonçalves, Jose J. Ramasco +2
Cultural areas represent a useful concept that cross-fertilizes diverse fields in social sciences. Knowledge of how humans organize and relate their ideas and behavior within a soc…
RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generators
Rilwan A. Adewoyin, Ritabrata Dutta, Yulan He
In this paper, we study the task of improving the cohesion and coherence of long-form text generated by language models. To this end, we propose RSTGen, a framework that utilises R…
Citizen Participation and Machine Learning for a Better Democracy
M. Arana-Catania, F. A. Van Lier, Rob Procter +4
The development of democratic systems is a crucial task as confirmed by its selection as one of the Millennium Sustainable Development Goals by the United Nations. In this article,…
The Gap on GAP: Tackling the Problem of Differing Data Distributions in Bias-Measuring Datasets
Vid Kocijan, Oana-Maria Camburu, Thomas Lukasiewicz
Diagnostic datasets that can detect biased models are an important prerequisite for bias reduction within natural language processing. However, undesired patterns in the collected…
HateCheck: Functional Tests for Hate Speech Detection Models
Paul Röttger, Bertram Vidgen, Dong Nguyen +3
Detecting online hate is a difficult task that even state-of-the-art models struggle with. Typically, hate speech detection models are evaluated by measuring their performance on h…
Directions in Abusive Language Training Data: Garbage In, Garbage Out
Bertie Vidgen, Leon Derczynski
Data-driven analysis and detection of abusive online content covers many different tasks, phenomena, contexts, and methodologies. This paper systematically reviews abusive language…
How we do things with words: Analyzing text as social and cultural data
Dong Nguyen, Maria Liakata, Simon DeDeo +4
In this article we describe our experiences with computational text analysis. We hope to achieve three primary goals. First, we aim to shed light on thorny issues not always at the…
A Surprisingly Robust Trick for Winograd Schema Challenge
Vid Kocijan, Ana-Maria Cretu, Oana-Maria Camburu +2
The Winograd Schema Challenge (WSC) dataset WSC273 and its inference counterpart WNLI are popular benchmarks for natural language understanding and commonsense reasoning. In this p…
GASC: Genre-Aware Semantic Change for Ancient Greek
Valerio Perrone, Marco Palma, Simon Hengchen +3
Word meaning changes over time, depending on linguistic and extra-linguistic factors. Associating a word's correct meaning in its historical context is a central challenge in diach…
Pull out all the stops: Textual analysis via punctuation sequences
Alexandra N. M. Darmon, Marya Bazzi, Sam D. Howison +1
Whether enjoying the lucid prose of a favorite author or slogging through some other writer's cumbersome, heavy-set prattle (full of parentheses, em dashes, compound adjectives, an…
ColNet: Embedding the Semantics of Web Tables for Column Type Prediction
Jiaoyan Chen, Ernesto Jimenez-Ruiz, Ian Horrocks +1
Automatically annotating column types with knowledge base (KB) concepts is a critical task to gain a basic understanding of web tables. Current methods rely on either table metadat…
Extracting Keywords from Open-Ended Business Survey Questions
Barbara McGillivray, Gard Jenset, Dominik Heil
Open-ended survey data constitute an important basis in research as well as for making business decisions. Collecting and manually analysing free-text survey data is generally more…
The Data Science of Hollywood: Using Emotional Arcs of Movies to Drive Business Model Innovation in Entertainment Industries
Marco Del Vecchio, Alexander Kharlamov, Glenn Parry +1
Much of business literature addresses the issues of consumer-centric design: how can businesses design customized services and products which accurately reflect consumer preference…
Generating Sentences Using a Dynamic Canvas
Harshil Shah, Bowen Zheng, David Barber
We introduce the Attentive Unsupervised Text (W)riter (AUTR), which is a word level generative model for natural language. It uses a recurrent neural network with a dynamic attenti…