477 citations · 1.7k across the 84 of their papers we have counts for
50 papers · 1 filter
Unsupervised Multi-document Summarization with Holistic Inference
Haopeng Zhang, Sangwoo Cho, Kaiqiang Song +4
Multi-document summarization aims to obtain core information from a collection of documents written on the same topic. This paper proposes a new holistic framework for unsupervised…
LASER: LLM Agent with State-Space Exploration for Web Navigation
Kaixin Ma, Hongming Zhang, Hongwei Wang +3
Large language models (LLMs) have been successfully adapted for interactive decision-making tasks like web navigation. While achieving decent performance, previous methods implicit…
Skills-in-Context Prompting: Unlocking Compositionality in Large Language Models
Jiaao Chen, Xiaoman Pan, Dian Yu +4
We investigate how to elicit compositional generalization capabilities in large language models (LLMs). Compositional generalization empowers LLMs to solve complex problems by comb…
Thrust: Adaptively Propels Large Language Models with External Knowledge
Xinran Zhao, Hongming Zhang, Xiaoman Pan +3
Although large-scale pre-trained language models (PTLMs) are shown to encode rich knowledge in their model parameters, the inherent knowledge in PTLMs can be opaque or static, maki…
PIVOINE: Instruction Tuning for Open-world Information Extraction
Keming Lu, Xiaoman Pan, Kaiqiang Song +3
We consider the problem of Open-world Information Extraction (Open-world IE), which extracts comprehensive entity profiles from unstructured texts. Different from the conventional…
Open-Domain Event Graph Induction for Mitigating Framing Bias
Siyi Liu, Hongming Zhang, Hongwei Wang +3
Researchers have proposed various information extraction (IE) techniques to convert news articles into structured knowledge for news understanding. However, none of the existing me…
Faithful Question Answering with Monte-Carlo Planning
Ruixin Hong, Hongming Zhang, Hong Zhao +2
Although large language models demonstrate remarkable question-answering performances, revealing the intermediate reasoning steps that the models faithfully follow remains challeng…
Bridging Continuous and Discrete Spaces: Interpretable Sentence Representation Learning via Compositional Operations
James Y. Huang, Wenlin Yao, Kaiqiang Song +3
Traditional sentence embedding models encode sentences into vector representations to capture useful properties such as the semantic similarity between sentences. However, in addit…
ZeroKBC: A Comprehensive Benchmark for Zero-Shot Knowledge Base Completion
Pei Chen, Wenlin Yao, Hongming Zhang +4
Knowledge base completion (KBC) aims to predict the missing links in knowledge graphs. Previous KBC tasks and approaches mainly focus on the setting where all test entities and rel…
OASum: Large-Scale Open Domain Aspect-based Summarization
Xianjun Yang, Kaiqiang Song, Sangwoo Cho +4
Aspect or query-based summarization has recently caught more attention, as it can generate differentiated summaries based on users' interests. However, the current dataset for aspe…
Efficient Zero-shot Event Extraction with Context-Definition Alignment
Hongming Zhang, Wenlin Yao, Dong Yu
Event extraction (EE) is the task of identifying interested event mentions from text. Conventional efforts mainly focus on the supervised setting. However, these supervised models…
Toward Unifying Text Segmentation and Long Document Summarization
Sangwoo Cho, Kaiqiang Song, Xiaoyang Wang +2
Text segmentation is important for signaling a document's structure. Without segmenting a long document into topically coherent sections, it is difficult for readers to comprehend…
Salience Allocation as Guidance for Abstractive Summarization
Fei Wang, Kaiqiang Song, Hongming Zhang +6
Abstractive summarization models typically learn to capture the salient information from scratch implicitly. Recent literature adds extractive summaries as guidance for abstractive…
Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination
Yue Yang, Wenlin Yao, Hongming Zhang +3
Large-scale pretrained language models have made significant advances in solving downstream language understanding tasks. However, they generally suffer from reporting bias, the ph…
Cross-Lingual Speaker Identification Using Distant Supervision
Ben Zhou, Dian Yu, Dong Yu +1
Speaker identification, determining which character said each utterance in literary text, benefits many downstream tasks. Most existing approaches use expert-defined rules or rule-…
Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models
Xiaoman Pan, Wenlin Yao, Hongming Zhang +3
Fully-parametric language models generally require a huge number of model parameters to store the necessary knowledge for solving multiple natural language tasks in zero/few-shot s…
Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks
Zhenhailong Wang, Xiaoman Pan, Dian Yu +3
Although large language models have achieved impressive zero-shot ability, the huge model size generally incurs high cost. Recently, semi-parametric language models, which augment…
Towards Abstractive Grounded Summarization of Podcast Transcripts
Kaiqiang Song, Chen Li, Xiaoyang Wang +2
Podcasts have recently shown a rapid rise in popularity. Summarization of podcast transcripts is of practical benefit to both content providers and consumers. It helps consumers to…
C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of References
Xiang Yue, Xiaoman Pan, Wenlin Yao +3
We consider the problem of pretraining a two-stage open-domain question answering (QA) system (retriever + reader) with strong transfer capabilities. The key challenge is how to co…
Learning-by-Narrating: Narrative Pre-Training for Zero-Shot Dialogue Comprehension
Chao Zhao, Wenlin Yao, Dian Yu +3
Comprehending a dialogue requires a model to capture diverse kinds of key information in the utterances, which are either scattered around or implicitly implied in different turns…
Integrating Lattice-Free MMI into End-to-End Speech Recognition
Jinchuan Tian, Jianwei Yu, Chao Weng +2
In automatic speech recognition (ASR) research, discriminative criteria have achieved superior performance in DNN-HMM systems. Given this success, the adoption of discriminative cr…
FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flows
Jianqiao Zhao, Yanyang Li, Wanyu Du +4
Despite recent progress in open-domain dialogue evaluation, how to develop automatic metrics remains an open problem. We explore the potential of dialogue evaluation featuring dial…
Improving Mandarin End-to-End Speech Recognition with Word N-gram Language Model
Jinchuan Tian, Jianwei Yu, Chao Weng +2
Despite the rapid progress of end-to-end (E2E) automatic speech recognition (ASR), it has been shown that incorporating external language models (LMs) into the decoding can further…
Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension
Hongyu Gong, Yelong Shen, Dian Yu +2
In this paper, we study machine reading comprehension (MRC) on long texts, where a model takes as inputs a lengthy document and a question and then extracts a text span from the do…