9 citations · 9 across the 3 of their papers we have counts for
3 papers
TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Tasks
Shubhra Kanti Karmaker Santu, Dongji Feng
While LLMs have shown great success in understanding and generating text in traditional conversational settings, their potential for performing ill-defined complex tasks is largely…
Zero-Shot Multi-Label Topic Inference with Sentence Encoders
Souvika Sarkar, Dongji Feng, Shubhra Kanti Karmaker Santu
Sentence encoders have indeed been shown to achieve superior performances for many downstream text-mining tasks and, thus, claimed to be fairly general. Inspired by this, we perfor…
Joint Upper & Lower Bound Normalization for IR Evaluation
Shubhra Kanti Karmaker Santu, Dongji Feng
In this paper, we present a novel perspective towards IR evaluation by proposing a new family of evaluation metrics where the existing popular metrics (e.g., nDCG, MAP) are customi…