350 citations · 652 across the 49 of their papers we have counts for
15 papers · 2 filters
Investigating the Emergent Audio Classification Ability of ASR Foundation Models
Rao Ma, Adian Liusie, Mark J. F. Gales +1
Text and vision foundation models can perform many tasks in a zero-shot setting, a desirable property that enables these systems to be applied in general and low-resource settings.…
Towards End-to-End Spoken Grammatical Error Correction
Stefano Bannò, Rao Ma, Mengjie Qian +2
Grammatical feedback is crucial for L2 learners, teachers, and testers. Spoken grammatical error correction (GEC) aims to supply feedback to L2 learners on their use of grammar whe…
Mitigating Word Bias in Zero-shot Prompt-based Classifiers
Adian Liusie, Potsawee Manakul, Mark J. F. Gales
Prompt-based classifiers are an attractive approach for zero-shot classification. However, the precise choice of the prompt template and label words can largely influence performan…
Zero-shot Audio Topic Reranking using Large Language Models
Mengjie Qian, Rao Ma, Adian Liusie +3
Multimodal Video Search by Examples (MVSE) investigates using video clips as the query term for information retrieval, rather than the more traditional text query. This enables far…
Analyzing Multiple-Choice Reading and Listening Comprehension Tests
Vatsal Raina, Adian Liusie, Mark Gales
Multiple-choice reading and listening comprehension tests are an important part of language assessment. Content creators for standard educational tests need to carefully curate que…
Adapting an ASR Foundation Model for Spoken Language Assessment
Rao Ma, Mengjie Qian, Mark J. F. Gales +1
A crucial part of an accurate and reliable spoken language assessment system is the underlying ASR model. Recently, large-scale pre-trained ASR foundation models such as Whisper ha…
LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models
Adian Liusie, Potsawee Manakul, Mark J. F. Gales
Current developments in large language models (LLMs) have enabled impressive zero-shot capabilities across various natural language tasks. An interesting application of these syste…
Can Generative Large Language Models Perform ASR Error Correction?
Rao Ma, Mengjie Qian, Potsawee Manakul +2
ASR error correction is an interesting option for post processing speech recognition system outputs. These error correction models are usually trained in a supervised fashion using…
Sentiment Perception Adversarial Attacks on Neural Machine Translation Systems
Vyas Raina, Mark Gales
With the advent of deep learning methods, Neural Machine Translation (NMT) systems have become increasingly powerful. However, deep learning based systems are susceptible to advers…
Sample Attackability in Natural Language Adversarial Attacks
Vyas Raina, Mark Gales
Adversarial attack research in natural language processing (NLP) has made significant progress in designing powerful attack methods and defence approaches. However, few efforts hav…
CUED at ProbSum 2023: Hierarchical Ensemble of Summarization Models
Potsawee Manakul, Yassir Fathullah, Adian Liusie +3
In this paper, we consider the challenge of summarizing patients' medical progress notes in a limited data setting. For the Problem List Summarization (shared task 1A) at the BioNL…
Analysis of the Cambridge Multiple-Choice Questions Reading Dataset with a Focus on Candidate Response Distribution
Adian Liusie, Vatsal Raina, Andrew Mullooly +2
Multiple choice exams are widely used to assess candidates across a diverse range of domains and tasks. To moderate question quality, newly proposed questions often pass through pr…
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
Potsawee Manakul, Adian Liusie, Mark J. F. Gales
Generative Large Language Models (LLMs) such as GPT-3 are capable of generating highly fluent responses to a wide variety of user prompts. However, LLMs are known to hallucinate fa…
N-best T5: Robust ASR Error Correction using Multiple Input Hypotheses and Constrained Decoding Space
Rao Ma, Mark J. F. Gales, Kate M. Knill +1
Error correction models form an important part of Automatic Speech Recognition (ASR) post-processing to improve the readability and quality of transcriptions. Most prior works use…
MQAG: Multiple-choice Question Answering and Generation for Assessing Information Consistency in Summarization
Potsawee Manakul, Adian Liusie, Mark J. F. Gales
State-of-the-art summarization systems can generate highly fluent summaries. These summaries, however, may contain factual inconsistencies and/or information not present in the sou…