350 citations · 652 across the 49 of their papers we have counts for
8 papers · 1 filter
Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems
Potsawee Manakul, Mark J. F. Gales
Transformer models have achieved state-of-the-art results in a wide range of NLP tasks including summarization. Training and inference using large transformer models can be computa…
An Initial Investigation of Non-Native Spoken Question-Answering
Vatsal Raina, Mark J. F. Gales
Text-based machine comprehension (MC) systems have a wide-range of applications, and standard corpora exist for developing and evaluating approaches. There has been far less resear…
Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks
Andrey Malinin, Neil Band, Ganshin +17
There has been significant research done on developing methods for improving robustness to distributional shift and uncertainty estimation. In contrast, only limited work has exami…
Long-Span Summarization via Local Attention and Content Selection
Potsawee Manakul, Mark J. F. Gales
Transformer-based models have achieved state-of-the-art results in a wide range of natural language processing (NLP) tasks including document summarization. Typically these systems…
Scaling Ensemble Distribution Distillation to Many Classes with Proxy Targets
Max Ryabinin, Andrey Malinin, Mark Gales
Ensembles of machine learning models yield improved system performance as well as robust and interpretable uncertainty estimates; however, their inference costs may often be prohib…
Attention Forcing for Machine Translation
Qingyun Dou, Yiting Lu, Potsawee Manakul +2
Auto-regressive sequence-to-sequence models with attention mechanisms have achieved state-of-the-art performance in various tasks including Text-To-Speech (TTS) and Neural Machine…
Should Ensemble Members Be Calibrated?
Xixin Wu, Mark Gales
Underlying the use of statistical approaches for a wide range of applications is the assumption that the probabilities obtained from a statistical model are representative of the "…
CUED_speech at TREC 2020 Podcast Summarisation Track
Potsawee Manakul, Mark Gales
In this paper, we describe our approach for the Podcast Summarisation challenge in TREC 2020. Given a podcast episode with its transcription, the goal is to generate a summary that…