33 citations · 49 across the 6 of their papers we have counts for
6 papers
QueryForm: A Simple Zero-shot Form Entity Query Framework
Zifeng Wang, Zizhao Zhang, Jacob Devlin +6
Zero-shot transfer learning for document understanding is a crucial yet under-investigated scenario to help reduce the high cost involved in annotating document entities. We presen…
Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models
Hao Zhang
Pre-trained language models (LMs), such as BERT (Devlin et al., 2018) and its variants, have led to significant improvements on various NLP tasks in past years. However, a theoreti…
Memory-Efficient Network for Large-scale Video Compressive Sensing
Ziheng Cheng, Bo Chen, Guanliang Liu +4
Video snapshot compressive imaging (SCI) captures a sequence of video frames in a single shot using a 2D detector. The underlying principle is that during one exposure time, differ…
TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models
Zhuohan Li, Siyuan Zhuang, Shiyuan Guo +4
Model parallelism has become a necessity for training modern large-scale deep language models. In this work, we identify a new and orthogonal dimension from existing model parallel…
Reinforcement Learning for Flexibility Design Problems
Yehua Wei, Lei Zhang, Ruiyi Zhang +3
Flexibility design problems are a class of problems that appear in strategic decision-making across industries, where the objective is to design a (, manufacturing) network t…
Building Interpretable Interaction Trees for Deep NLP Models
Die Zhang, Huilin Zhou, Hao Zhang +6
This paper proposes a method to disentangle and quantify interactions among words that are encoded inside a DNN for natural language processing. We construct a tree to encode salie…