27 citations · 113 across the 17 of their papers we have counts for
17 papers
Debiasing Neural Retrieval via In-batch Balancing Regularization
Yuantong Li, Xiaokai Wei, Zijian Wang +4
People frequently interact with information retrieval (IR) systems, however, IR models exhibit biases and discrimination towards various demographics. The in-processing fair rankin…
Learning Dialogue Representations from Consecutive Utterances
Zhihan Zhou, Dejiao Zhang, Wei Xiao +4
Learning high-quality dialogue representations is essential for solving a variety of dialogue-oriented tasks, especially considering that dialogue systems often suffer from data sc…
Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner
Danilo Ribeiro, Shen Wang, Xiaofei Ma +8
Large language models have achieved high performance on various question answering (QA) benchmarks, but the explainability of their output remains elusive. Structured explanations,…
DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization
Zheng Li, Zijian Wang, Ming Tan +5
Large-scale pre-trained sequence-to-sequence models like BART and T5 achieve state-of-the-art performance on many generative NLP tasks. However, such models pose a great challenge…
QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition
Andy T. Liu, Wei Xiao, Henghui Zhu +3
Recently, prompt-based learning for pre-trained language models has succeeded in few-shot Named Entity Recognition (NER) by exploiting prompts as task guidance to increase label ef…
Self-Supervised Speaker Verification with Simple Siamese Network and Self-Supervised Regularization
Mufan Sang, Haoqi Li, Fang Liu +2
Training speaker-discriminative and robust speaker verification systems without speaker labels is still challenging and worthwhile to explore. In this study, we propose an effectiv…
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey
Xiaokai Wei, Shen Wang, Dejiao Zhang +2
Pretrained Language Models (PLM) have established a new paradigm through learning informative contextualized representations on large-scale text corpus. This new paradigm has revol…
Virtual Augmentation Supported Contrastive Learning of Sentence Representations
Dejiao Zhang, Wei Xiao, Henghui Zhu +2
Despite profound successes, contrastive representation learning relies on carefully designed data augmentations using domain specific knowledge. This challenge is magnified in natu…
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora
Xisen Jin, Dejiao Zhang, Henghui Zhu +5
Pretrained language models (PTLMs) are typically learned over a large, static corpus and further fine-tuned for various downstream tasks. However, when deployed in the real world,…
Pairwise Supervised Contrastive Learning of Sentence Representations
Dejiao Zhang, Shang-Wen Li, Wei Xiao +4
Many recent successes in sentence representation learning have been achieved by simply fine-tuning on the Natural Language Inference (NLI) datasets with triplet loss or siamese los…
Contrastive Fine-tuning Improves Robustness for Neural Rankers
Xiaofei Ma, Cicero Nogueira dos Santos, Andrew O. Arnold
The performance of state-of-the-art neural rankers can deteriorate substantially when exposed to noisy inputs or applied to a new domain. In this paper, we present a novel method f…
Improving Factual Consistency of Abstractive Summarization via Question Answering
Feng Nan, Cicero Nogueira dos Santos, Henghui Zhu +7
A commonly observed problem with the state-of-the art abstractive summarization models is that the generated summaries can be factually inconsistent with the input documents. The f…
Supporting Clustering with Contrastive Learning
Dejiao Zhang, Feng Nan, Xiaokai Wei +6
Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often ove…
Neural document expansion for ad-hoc information retrieval
Cheng Tang, Andrew Arnold
Recently, Nogueira et al. [2019] proposed a new approach to document expansion based on a neural Seq2Seq model, showing significant improvement on short text retrieval task. Howeve…
Answering Ambiguous Questions through Generative Evidence Fusion and Round-Trip Prediction
Yifan Gao, Henghui Zhu, Patrick Ng +7
In open-domain question answering, questions are highly likely to be ambiguous because users may not know the scope of relevant topics when formulating them. Therefore, a system ne…
Faithful Embeddings for Knowledge Base Queries
Haitian Sun, Andrew O. Arnold, Tania Bedrax-Weiss +2
The deductive closure of an ideal knowledge base (KB) contains exactly the logical queries that the KB can answer. However, in practice KBs are both incomplete and over-specified,…
Instance-based Transfer Learning for Multilingual Deep Retrieval
Andrew O. Arnold, William W. Cohen
We focus on the problem of search in the multilingual setting. Examining the problems of next-sentence prediction and inverse cloze, we show that at large scale, instance-based tra…