22 citations · 33 across the 9 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020
Language Models are Open Knowledge Graphs
Chenguang Wang, Xiao Liu, Dawn Song
This paper shows how to construct knowledge graphs (KGs) from pre-trained language models (e.g., BERT, GPT-2/3), without human supervision. Popular KGs (e.g, Wikidata, NELL) are bu…
cs.CL2020★ 4 cited
Transformer on a Diet
Chenguang Wang, Zihao Ye, Aston Zhang +2
Transformer has been widely used thanks to its ability to capture sequence information in an efficient way. However, recent developments, such as BERT and GPT-2, deliver only heavy…