200 citations · 223 across the 9 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CL2020★ 4 cited
Optimizing Deeper Transformers on Small Datasets
Peng Xu, Dhruv Kumar, Wei Yang +6
It is a common belief that training deep transformers from scratch requires large datasets. Consequently, for small datasets, people usually use shallow and simple additional layer…
cs.CL2020★ 17 cited
Rapid Adaptation of BERT for Information Extraction on Domain-Specific Business Documents
Ruixue Zhang, Wei Yang, Luyun Lin +7
Techniques for automatically extracting important content elements from business documents such as contracts, statements, and filings have the potential to make business operations…
cs.CL2020
Integrating Discrete and Neural Features via Mixed-feature Trans-dimensional Random Field Language Models
Silin Gao, Zhijian Ou, Wei Yang +1
There has been a long recognition that discrete features (n-gram features) and neural network based features have complementary strengths for language models (LMs). Improved perfor…