13 citations · 14 across the 8 of their papers we have counts for
9 papers
SciDQA: A Deep Reading Comprehension Dataset over Scientific Papers
Shruti Singh, Nandan Sarkar, Arman Cohan
Scientific literature is typically dense, requiring significant background knowledge and deep comprehension for effective engagement. We introduce SciDQA, a new dataset for reading…
SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature
David Wadden, Kejian Shi, Jacob Morrison +11
We present SciRIFF (Scientific Resource for Instruction-Following and Finetuning), a dataset of 137K instruction-following instances for training and evaluation, covering 54 tasks.…
LEGOBench: Scientific Leaderboard Generation Benchmark
Shruti Singh, Shoaib Alam, Husain Malwat +1
The ever-increasing volume of paper submissions makes it difficult to stay informed about the latest state-of-the-art research. To address this challenge, we introduce LEGOBench, a…
Unlocking Model Insights: A Dataset for Automated Model Card Generation
Shruti Singh, Hitesh Lodwal, Husain Malwat +2
Language models (LMs) are no longer restricted to ML community, and instruction-tuned LMs have led to a rise in autonomous AI agents. As the accessibility of LMs grows, it is imper…
The Inefficiency of Language Models in Scholarly Retrieval: An Experimental Walk-through
Shruti Singh, Mayank Singh
Language models are increasingly becoming popular in AI-powered scientific IR systems. This paper evaluates popular scientific language models in handling (i) short-query texts and…
COMPARE: A Taxonomy and Dataset of Comparison Discussions in Peer Reviews
Shruti Singh, Mayank Singh, Pawan Goyal
Comparing research papers is a conventional method to demonstrate progress in experimental research. We present COMPARE, a taxonomy and a dataset of comparison discussions in peer…
TweeNLP: A Twitter Exploration Portal for Natural Language Processing
Viraj Shah, Shruti Singh, Mayank Singh
We present TweeNLP, a one-stop portal that organizes Twitter's natural language processing (NLP) data and builds a visualization and exploration platform. It curates 19,395 tweets…
Understanding Attention: In Minds and Machines
Shriraj P. Sawant, Shruti Singh
Attention is a complex and broad concept, studied across multiple disciplines spanning artificial intelligence, cognitive science, psychology, neuroscience, and related fields. Alt…
NLPExplorer: Exploring the Universe of NLP Papers
Monarch Parmar, Naman Jain, Pranjali Jain +4
Understanding the current research trends, problems, and their innovative solutions remains a bottleneck due to the ever-increasing volume of scientific articles. In this paper, we…