37 citations · 60 across the 10 of their papers we have counts for
10 papers
Circuit Distillation
Somin Wadhwa, Silvio Amir, Byron C. Wallace
Model distillation typically focuses on behavioral mimicry, where a student model is trained to replicate a teacher's output while treating its internal computations as a black box…
Who Taught You That? Tracing Teachers in Model Distillation
Somin Wadhwa, Chantal Shaib, Silvio Amir +1
Model distillation -- using outputs from a large teacher model to teach a small student model -- is a practical means of creating efficient models for a particular task. We ask: Ca…
Investigating Mysteries of CoT-Augmented Distillation
Somin Wadhwa, Silvio Amir, Byron C. Wallace
Eliciting "chain of thought" (CoT) rationales -- sequences of token that convey a "reasoning" process -- has been shown to consistently improve LLM performance on tasks like questi…
Learning from Natural Language Explanations for Generalizable Entity Matching
Somin Wadhwa, Adit Krishnan, Runhui Wang +2
Entity matching is the task of linking records from different sources that refer to the same real-world entity. Past work has primarily treated entity linking as a standard supervi…
Distilling Event Sequence Knowledge From Large Language Models
Somin Wadhwa, Oktie Hassanzadeh, Debarun Bhattacharjya +2
Event sequence models have been found to be highly effective in the analysis and prediction of events. Building such models requires availability of abundant high-quality event seq…
Revisiting Relation Extraction in the era of Large Language Models
Somin Wadhwa, Silvio Amir, Byron C. Wallace
Relation extraction (RE) is the core NLP task of inferring semantic relationships between entities from text. Standard supervised RE techniques entail training modules to tag token…
Jointly Extracting Interventions, Outcomes, and Findings from RCT Reports with LLMs
Somin Wadhwa, Jay DeYoung, Benjamin Nye +2
Results from Randomized Controlled Trials (RCTs) establish the comparative effectiveness of interventions, and are in turn critical inputs for evidence-based care. However, results…
RedHOT: A Corpus of Annotated Medical Questions, Experiences, and Claims on Social Media
Somin Wadhwa, Vivek Khetan, Silvio Amir +1
We present Reddit Health Online Talk (RedHOT), a corpus of 22,000 richly annotated social media posts from Reddit spanning 24 health conditions. Annotations include demarcations of…
CommunityClick: Capturing and Reporting Community Feedback from Town Halls to Improve Inclusivity
Mahmood Jasim, Pooya Khaloo, Somin Wadhwa +3
Local governments still depend on traditional town halls for community consultation, despite problems such as a lack of inclusive participation for attendees and difficulty for civ…
Semi-Automating Knowledge Base Construction for Cancer Genetics
Somin Wadhwa, Kanhua Yin, Kevin S. Hughes +1
In this work, we consider the exponentially growing subarea of genetics in cancer. The need to synthesize and centralize this evidence for dissemination has motivated a team of phy…