2.1k citations · 6.8k across the 40 of their papers we have counts for
4 papers · 1 filter
Deep Physiological State Space Model for Clinical Forecasting
Yuan Xue, Denny Zhou, Nan Du +4
Clinical forecasting based on electronic medical records (EMR) can uncover the temporal correlations between patients' conditions and outcomes from sequences of longitudinal clinic…
Extremely Small BERT Models from Mixed-Vocabulary Training
Sanqiang Zhao, Raghav Gupta, Yang Song +1
Pretrained language models like BERT have achieved good results on NLP tasks, but are impractical on resource-limited devices due to memory footprint. A large fraction of this foot…
Neural Logic Machines
Honghua Dong, Jiayuan Mao, Tian Lin +3
We propose the Neural Logic Machine (NLM), a neural-symbolic architecture for both inductive learning and logic reasoning. NLMs exploit the power of both neural networks---as funct…
Doubly Sparse: Sparse Mixture of Sparse Experts for Efficient Softmax Inference
Shun Liao, Ting Chen, Tian Lin +2
Computations for the softmax function are significantly expensive when the number of output classes is large. In this paper, we present a novel softmax inference speedup method, Do…