95 citations · 105 across the 4 of their papers we have counts for
4 papers
AXLearn: Modular, Hardware-Agnostic Large Model Training
Mark Lee, Chang Lan, Tom Gunter +34
AXLearn is a production system which facilitates scalable and high-performance training of large deep learning models. Compared to other state-of-art deep learning systems, AXLearn…
Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks
Rajiv Movva, Jinhao Lei, Shayne Longpre +2
Quantization, knowledge distillation, and magnitude pruning are among the most popular methods for neural network compression in NLP. Independently, these methods reduce model size…
Accurate Protein Structure Prediction by Embeddings and Deep Learning Representations
Iddo Drori, Darshan Thaker, Arjun Srivatsa +15
Proteins are the major building blocks of life, and actuators of almost all chemical and biophysical events in living organisms. Their native structures in turn enable their biolog…
Linguistically Regularized LSTMs for Sentiment Classification
Qiao Qian, Minlie Huang, Jinhao Lei +1
Sentiment understanding has been a long-term goal of AI in the past decades. This paper deals with sentence-level sentiment classification. Though a variety of neural network model…