2 citations · 2 across the 6 of their papers we have counts for
6 papers · 1 filter
Benchmarking LLMs on the Semantic Overlap Summarization Task
John Salvador, Naman Bansal, Mousumi Akter +3
Semantic Overlap Summarization (SOS) is a constrained multi-document summarization task, where the constraint is to capture the common/overlapping information between two alternati…
LLMs as Meta-Reviewers' Assistants: A Case Study
Eftekhar Hossain, Sanjeev Kumar Sinha, Naman Bansal +11
One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves assimilating diverse opinions from multiple expert peer…
FaNS: a Facet-based Narrative Similarity Metric
Mousumi Akter, Shubhra Kanti Karmaker Santu
Similar Narrative Retrieval is a crucial task since narratives are essential for explaining and understanding events, and multiple related narratives often help to create a holisti…
Redundancy Aware Multi-Reference Based Gainwise Evaluation of Extractive Summarization
Mousumi Akter, Santu Karmaker
The ROUGE metric is commonly used to evaluate extractive summarization task, but it has been criticized for its lack of semantic awareness and its ignorance about the ranking quali…
On Evaluation of Bangla Word Analogies
Mousumi Akter, Souvika Sarkar, Shubhra Kanti Karmaker Santu
This paper presents a high-quality dataset for evaluating the quality of Bangla word embeddings, which is a fundamental task in the field of Natural Language Processing (NLP). Desp…
Multi-Narrative Semantic Overlap Task: Evaluation and Benchmark
Naman Bansal, Mousumi Akter, Shubhra Kanti Karmaker Santu
In this paper, we introduce an important yet relatively unexplored NLP task called Multi-Narrative Semantic Overlap (MNSO), which entails generating a Semantic Overlap of multiple…