1 citations · 1 across the 2 of their papers we have counts for
5 papers
Intrinsic Knowledge Evaluation on Chinese Language Models
Zhiruo Wang, Renfen Hu
Recent NLP tasks have benefited a lot from pre-trained language models (LM) since they are able to encode knowledge of various aspects. However, current LM evaluations focus on dow…
Quantum Inspired Word Representation and Computation
Shen Li, Renfen Hu, Jinshan Wu
Word meaning has different aspects, while the existing word representation "compresses" these aspects into a single vector, and it needs further analysis to recover the information…
Self-Balanced Dropout
Shen Li, Chenhao Su, Renfen Hu +1
Dropout is known as an effective way to reduce overfitting via preventing co-adaptations of units. In this paper, we theoretically prove that the co-adaptation problem still exists…
From Random to Supervised: A Novel Dropout Mechanism Integrated with Global Information
Hengru Xu, Shen Li, Renfen Hu +2
Dropout is used to avoid overfitting by randomly dropping units from the neural networks during training. Inspired by dropout, this paper presents GI-Dropout, a novel dropout metho…
Analogical Reasoning on Chinese Morphological and Semantic Relations
Shen Li, Zhe Zhao, Renfen Hu +3
Analogical reasoning is effective in capturing linguistic regularities. This paper proposes an analogical reasoning task on Chinese. After delving into Chinese lexical knowledge, w…