Publications (11)
WebQuest: A Benchmark for Multimodal QA on Web Page Sequences
Maria Wang, Srinivas Sunkara, Gilles Baechler +5
The rise of powerful multimodal LLMs has enhanced the viability of building web agents which can, with increasing levels of autonomy, assist users to retrieve information and compl…
Privy: Envisioning and Mitigating Privacy Risks for Consumer-facing AI Product Concepts
Hao-Ping Lee, Yu-Ju Yang, Matthew Bilik +7
AI creates and exacerbates privacy risks, yet practitioners lack effective resources to identify and mitigate these risks. We present Privy, a tool that guides practitioners withou…
Explore, Establish, Exploit: Red Teaming Language Models from Scratch
Stephen Casper, Jason Lin, Joe Kwon +2
Deploying large language models (LMs) can pose hazards from harmful outputs such as toxic or false text. Prior work has introduced automated tools that elicit harmful outputs to id…
Zorro: the masked multimodal transformer
Adrià Recasens, Jason Lin, JoÄo Carreira +8
Attention-based models are appealing for multimodal processing because inputs from multiple modalities can be concatenated and fed to a single backbone network - thus requiring ver…
The NIAID Discovery Portal: A Unified Search Engine for Infectious and Immune-Mediated Disease Datasets
Ginger Tsueng, Emily Bullen, Candice Czech +18
The NIAID Data Ecosystem Discovery Portal (https://data.niaid.nih.gov) provides a unified search interface for over 4 million datasets relevant to infectious and immune-mediated di…
Interactive Classification for Deep Learning Interpretation
Ãngel Alexander Cabrera, Fred Hohman, Jason Lin +1
We present an interactive system enabling users to manipulate images to explore the robustness and sensitivity of deep learning image classifiers. Using modern web technologies to…