18 citations · 37 across the 7 of their papers we have counts for
8 papers
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media
Xiang Dai, Sarvnaz Karimi, Ben Hachey +1
Recent studies on domain-specific BERT models show that effectiveness on downstream tasks can be improved when models are pretrained on in-domain data. Often, the pretraining data…
An Effective Transition-based Model for Discontinuous NER
Xiang Dai, Sarvnaz Karimi, Ben Hachey +1
Unlike widely used Named Entity Recognition (NER) data sets in generic domains, biomedical NER data sets often contain mentions consisting of discontinuous spans. Conventional sequ…
NNE: A Dataset for Nested Named Entity Recognition in English Newswire
Nicky Ringland, Xiang Dai, Ben Hachey +3
Named entity recognition (NER) is widely used in natural language processing applications and downstream tasks. However, most NER tools target flat annotation from popular datasets…
Using Similarity Measures to Select Pretraining Data for NER
Xiang Dai, Sarvnaz Karimi, Ben Hachey +1
Word vectors and Language Models (LMs) pretrained on a large amount of unlabelled data can dramatically improve various Natural Language Processing (NLP) tasks. However, the measur…
Learning to generate one-sentence biographies from Wikidata
Andrew Chisholm, Will Radford, Ben Hachey
We investigate the generation of one-sentence Wikipedia biographies from facts derived from Wikidata slot-value pairs. We train a recurrent neural network sequence-to-sequence mode…
Post-edit Analysis of Collective Biography Generation
Bo Han, Will Radford, Anaïs Cadilhac +3
Text generation is increasingly common but often requires manual post-editing where high precision is critical to end users. However, manual editing is expensive so we want to ensu…
:telephone::person::sailboat::whale::okhand:; or "Call me Ishmael" - How do you translate emoji?
Will Radford, Andrew Chisholm, Ben Hachey +1
We report on an exploratory analysis of Emoji Dick, a project that leverages crowdsourcing to translate Melville's Moby Dick into emoji. This distinctive use of emoji removes textu…
Presenting a New Dataset for the Timeline Generation Problem
Xavier Holt, Will Radford, Ben Hachey
The timeline generation task summarises an entity's biography by selecting stories representing key events from a large pool of relevant documents. This paper addresses the lack of…