5 citations · 17 across the 18 of their papers we have counts for
19 papers
Characterizing Mamba's Selective Memory using Auto-Encoders
Tamanna Hossain, Robert L. Logan, Ganesh Jagadeesan +3
State space models (SSMs) are a promising alternative to transformers for language modeling because they use fixed memory during inference. However, this fixed memory usage require…
CEHA: A Dataset of Conflict Events in the Horn of Africa
Rui Bai, Di Lu, Shihao Ran +5
Natural Language Processing (NLP) of news articles can play an important role in understanding the dynamics and causes of violent conflict. Despite the availability of datasets cat…
HumVI: A Multilingual Dataset for Detecting Violent Incidents Impacting Humanitarian Aid
Hemank Lamba, Anton Abilov, Ke Zhang +8
Humanitarian organizations can enhance their effectiveness by analyzing data to discover trends, gather aggregated insights, manage their security risks, support decision-making, a…
Dissecting users' needs for search result explanations
Prerna Juneja, Wenjuan Zhang, Alison Marie Smith-Renner +3
There is a growing demand for transparency in search engines to understand how search results are curated and to enhance users' trust. Prior research has introduced search result e…
Explain then Rank: Scale Calibration of Neural Rankers Using Natural Language Explanations from LLMs
Puxuan Yu, Daniel Cohen, Hemank Lamba +2
In search settings, calibrating the scores during the ranking process to quantities such as click-through rates or relevance levels enhances a system's usefulness and trustworthine…
Little Giants: Exploring the Potential of Small LLMs as Evaluation Metrics in Summarization in the Eval4NLP 2023 Shared Task
Neema Kotonya, Saran Krishnasamy, Joel Tetreault +1
This paper describes and analyzes our participation in the 2023 Eval4NLP shared task, which focuses on assessing the effectiveness of prompt-based techniques to empower Large Langu…
Event Extraction as Question Generation and Answering
Di Lu, Shihao Ran, Joel Tetreault +1
Recent work on Event Extraction has reframed the task as Question Answering (QA), with promising results. The advantage of this approach is that it addresses the error propagation…
A New Task and Dataset on Detecting Attacks on Human Rights Defenders
Shihao Ran, Di Lu, Joel Tetreault +2
The ability to conduct retrospective analyses of attacks on human rights defenders over time and by location is important for humanitarian organizations to better understand histor…
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
Anya Belz, Craig Thomson, Ehud Reiter +39
We report our efforts in identifying a set of previous human evaluations in NLP that would be suitable for a coordinated study examining what makes human evaluations in NLP more/le…
Counterfactual Editing for Search Result Explanation
Zhichao Xu, Hemank Lamba, Qingyao Ai +2
Search Result Explanation (SeRE) aims to improve search sessions' effectiveness and efficiency by helping users interpret documents' relevance. Existing works mostly focus on factu…
BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics
Liang Ma, Shuyang Cao, Robert L. Logan +5
The proliferation of automatic faithfulness metrics for summarization has produced a need for benchmarks to evaluate them. While existing benchmarks measure the correlation with hu…
CrisisLTLSum: A Benchmark for Local Crisis Event Timeline Extraction and Summarization
Hossein Rajaby Faghihi, Bashar Alhafni, Ke Zhang +3
Social media has increasingly played a key role in emergency response: first responders can use public posts to better react to ongoing crisis events and deploy the necessary resou…
Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer
Sharan Narasimhan, Suvodip Dey, Maunendra Sankar Desarkar
Recent studies show that auto-encoder based approaches successfully perform language generation, smooth sentence interpolation, and style transfer over unseen attributes using unla…
Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer
Eleftheria Briakou, Sweta Agrawal, Joel Tetreault +1
While the field of style transfer (ST) has been growing rapidly, it has been hampered by a lack of standardized practices for automatic evaluation. In this paper, we evaluate leadi…
Journalistic Guidelines Aware News Image Captioning
Xuewen Yang, Svebor Karaman, Joel Tetreault +1
The task of news article image captioning aims to generate descriptive and informative captions for news article images. Unlike conventional image captions that simply describe the…
A Review of Human Evaluation for Style Transfer
Eleftheria Briakou, Sweta Agrawal, Ke Zhang +2
This paper reviews and summarizes human evaluation practices described in 97 style transfer papers with respect to three main evaluation aspects: style transfer, meaning preservati…
GTN-ED: Event Detection Using Graph Transformer Networks
Sanghamitra Dutta, Liang Ma, Tanay Kumar Saha +3
Recent works show that the graph structure of sentences, generated from dependency parsers, has potential for improving event detection. However, they often only leverage the edges…
XFORMAL: A Benchmark for Multilingual Formality Style Transfer
Eleftheria Briakou, Di Lu, Ke Zhang +1
We take the first step towards multilingual style transfer by creating and releasing XFORMAL, a benchmark of multiple formal reformulations of informal text in Brazilian Portuguese…
The ApposCorpus: A new multilingual, multi-domain dataset for factual appositive generation
Yova Kementchedjhieva, Di Lu, Joel Tetreault
News articles, image captions, product reviews and many other texts mention people and organizations whose name recognition could vary for different audiences. In such cases, backg…