20 citations · 80 across the 28 of their papers we have counts for
29 papers
Exploring Demonstration Ensembling for In-context Learning
Muhammad Khalifa, Lajanugen Logeswaran, Moontae Lee +2
In-context learning (ICL) operates by showing language models (LMs) examples of input-output pairs for a given task, i.e., demonstrations. The standard approach for ICL is to promp…
BOLT: Fast Energy-based Controlled Text Generation with Tunable Biases
Xin Liu, Muhammad Khalifa, Lu Wang
Energy-based models (EBMs) have gained popularity for controlled text generation due to their high applicability to a wide range of constraints. However, sampling from EBMs is non-…
GRACE: Discriminator-Guided Chain-of-Thought Reasoning
Muhammad Khalifa, Lajanugen Logeswaran, Moontae Lee +2
In the context of multi-step reasoning, e.g., with chain-of-thought, language models (LMs) can easily assign a high likelihood to incorrect steps. As a result, decoding strategies…
AWESOME: GPU Memory-constrained Long Document Summarization using Memory Mechanism and Global Salient Content
Shuyang Cao, Lu Wang
Long document summarization systems are critical for domains with lengthy and jargonladen text, yet they present significant challenges to researchers and developers with limited c…
You Are What You Annotate: Towards Better Models through Annotator Representations
Naihao Deng, Xinliang Frederick Zhang, Siyang Liu +3
Annotator disagreement is ubiquitous in natural language processing (NLP) tasks. There are multiple reasons for such disagreements, including the subjectivity of the task, difficul…
Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluation
Qi Zeng, Mankeerat Sidhu, Ansel Blume +3
Opinions in scientific research papers can be divergent, leading to controversies among reviewers. However, most existing datasets for opinion summarization are centered around pro…