15 citations · 30 across the 3 of their papers we have counts for
3 papers
cs.AI2021★ 15 cited
Pre-Trained Models: Past, Present and Future
Xu Han, Zhengyan Zhang, Ning Ding +21
Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved great success and become a milestone in the field of artificial intelligence (AI). Owing to sophis…
cs.LG2021
Learning Structures for Deep Neural Networks
Jinhui Yuan, Fei Pan, Chunting Zhou +2
In this paper, we focus on the unsupervised setting for structure learning of deep neural networks and propose to adopt the efficient coding principle, rooted in information theory…
stat.ML2014★ 15 cited
LightLDA: Big Topic Models on Modest Compute Clusters
Jinhui Yuan, Fei Gao, Qirong Ho +6
When building large-scale machine learning (ML) programs, such as big topic models or deep neural nets, one usually assumes such tasks can only be attempted with industrial-sized c…