activity
20182024
most citedStress Test Evaluation for Natural Language Inference

41 citations · 113 across the 16 of their papers we have counts for

collaborators

17 papers

cs.CL2024★ 1 cited

SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature

David Wadden, Kejian Shi, Jacob Morrison +11

We present SciRIFF (Scientific Resource for Instruction-Following and Finetuning), a dataset of 137K instruction-following instances for training and evaluation, covering 54 tasks.…

cs.CL2024★ 2 cited

On-the-fly Definition Augmentation of LLMs for Biomedical NER

Monica Munnangi, Sergey Feldman, Byron C Wallace +3

Despite their general capabilities, LLMs still struggle on biomedical NER tasks, which are difficult due to the presence of specialized terminology and lack of training data. In th…

cs.CL2024★ 11 cited

OLMo: Accelerating the Science of Language Models

Dirk Groeneveld, Iz Beltagy, Pete Walsh +40

Language models (LMs) have become ubiquitous in both NLP research and in commercial product offerings. As their commercial importance has surged, the most powerful models have beco…

cs.CL2024★ 10 cited

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Luca Soldaini, Rodney Kinney, Akshita Bhagia +33

Information about pretraining corpora used to train the current best-performing language models is seldom discussed: commercial models rarely detail their data, and even open model…

cs.CL2023

CARE: Extracting Experimental Findings From Clinical Literature

Aakanksha Naik, Bailey Kuehl, Erin Bransom +2

Extracting fine-grained experimental findings from literature can provide dramatic utility for scientific applications. Prior work has developed annotation schemas and datasets for…

cs.AI2023

SynerGPT: In-Context Learning for Personalized Drug Synergy Prediction and Drug Design

Carl Edwards, Aakanksha Naik, Tushar Khot +3

Predicting synergistic drug combinations can help accelerate discovery of cancer treatments, particularly therapies personalized to a patient's specific tumor via biopsied cells. I…

cs.CL2023

S2abEL: A Dataset for Entity Linking from Scientific Tables

Yuze Lou, Bailey Kuehl, Erin Bransom +3

Entity linking (EL) is the task of linking a textual mention to its corresponding entry in a knowledge base, and is critical for many knowledge-intensive NLP applications. When app…

cs.HC2023★ 8 cited

The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfaces

Kyle Lo, Joseph Chee Chang, Andrew Head +52

Scholarly publications are key to the transfer of knowledge from scholars to others. However, research papers are information-dense, and as the volume of the scientific literature…

cs.HC2023★ 38 cited

Relatedly: Scaffolding Literature Reviews with Existing Related Work Sections

Srishti Palani, Aakanksha Naik, Doug Downey +3

Scholars who want to research a scientific topic must take time to read, extract meaning, and identify connections across many papers. As scientific literature grows, this becomes…

cs.CL2022★ 1 cited

Distilling Multi-Scale Knowledge for Event Temporal Relation Extraction

Hao-Ren Yao, Luke Breitfeller, Aakanksha Naik +2

Event Temporal Relation Extraction (ETRE) is paramount but challenging. Within a discourse, event pairs are situated at different distances or the so-called proximity bands. The te…

cs.CL2021

Literature-Augmented Clinical Outcome Prediction

Aakanksha Naik, Sravanthi Parasa, Sergey Feldman +2

We present BEEP (Biomedical Evidence-Enhanced Predictions), a novel approach for clinical outcome prediction that retrieves patient-specific medical literature and incorporates it…

cs.CL2021

Adapting to the Long Tail: A Meta-Analysis of Transfer Learning Research for Language Understanding Tasks

Aakanksha Naik, Jill Lehman, Carolyn Rose

Natural language understanding (NLU) has made massive progress driven by large benchmarks, but benchmarks often leave a long tail of infrequent phenomena underrepresented. We refle…

cs.CL2021★ 1 cited

STAGE: Tool for Automated Extraction of Semantic Time Cues to Enrich Neural Temporal Ordering Models

Luke Breitfeller, Aakanksha Naik, Carolyn Rose

Despite achieving state-of-the-art accuracy on temporal ordering of events, neural models showcase significant gaps in performance. Our work seeks to fill one of these gaps by leve…

cs.CL2020

Adapting Event Extractors to Medical Data: Bridging the Covariate Shift

Aakanksha Naik, Jill Lehman, Carolyn Rose

We tackle the task of adapting event extractors to new domains without labeled data, by aligning the marginal distributions of source and target domains. As a testbed, we create tw…

cs.CL2020

Towards Open Domain Event Trigger Identification using Adversarial Domain Adaptation

Aakanksha Naik, Carolyn Rosé

We tackle the task of building supervised event trigger identification models which can generalize better across domains. Our work leverages the adversarial domain adaptation (ADA)…

cs.CL2019

EQUATE: A Benchmark Evaluation Framework for Quantitative Reasoning in Natural Language Inference

Abhilasha Ravichander, Aakanksha Naik, Carolyn Rose +1

Quantitative reasoning is a higher-order reasoning skill that any intelligent natural language understanding system can reasonably be expected to handle. We present EQUATE (Evaluat…

cs.CL2018★ 41 cited

Stress Test Evaluation for Natural Language Inference

Aakanksha Naik, Abhilasha Ravichander, Norman Sadeh +2

Natural language inference (NLI) is the task of determining if a natural language hypothesis can be inferred from a given premise in a justifiable manner. NLI was proposed as a ben…