2 citations · 5 across the 5 of their papers we have counts for
6 papers
Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefixes
Kuan-Hao Huang, Liang Tan, Rui Hou +3
Many real-world applications require making multiple predictions from the same text. Fine-tuning a large pre-trained language model for each downstream task causes computational bu…
Defending Against Patch-based Backdoor Attacks on Self-Supervised Learning
Ajinkya Tejankar, Maziar Sanjabi, Qifan Wang +4
Recently, self-supervised learning (SSL) was shown to be vulnerable to patch-based data poisoning backdoor attacks. It was shown that an adversary can poison a small part of the un…
UNIREX: A Unified Learning Framework for Language Model Rationale Extraction
Aaron Chan, Maziar Sanjabi, Lambert Mathias +5
An extractive rationale explains a language model's (LM's) prediction on a given task instance by highlighting the text inputs that most influenced the prediction. Ideally, rationa…
MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding
Woojeong Jin, Maziar Sanjabi, Shaoliang Nie +3
To reduce a model size but retain performance, we often rely on knowledge distillation (KD) which transfers knowledge from a large "teacher" model to a smaller "student" model. How…
Molecular-scale Description of SPAN80 Desorption from the Squalane-Water Interface
L. Tan, L. R. Pratt, M. I. Chaudhari
Extensive all-atom molecular dynamics calculations on the water-squalane interface for nine different loadings with sorbitan monooleate (SPAN80), at K, are analyzed for the…
Molecular theory and the effects of solute attractive forces on hydrophobic interactions
M. I. Chaudhari, S. B. Rempe, D. Asthagiri +2
The role of solute attractive forces on hydrophobic interactions is studied by coordinated development of theory and simulation results for Ar atoms in water. We present a concise…