5 papers
Quantum Inspired Word Representation and Computation
Shen Li, Renfen Hu, Jinshan Wu
Word meaning has different aspects, while the existing word representation "compresses" these aspects into a single vector, and it needs further analysis to recover the information…
Self-Balanced Dropout
Shen Li, Chenhao Su, Renfen Hu +1
Dropout is known as an effective way to reduce overfitting via preventing co-adaptations of units. In this paper, we theoretically prove that the co-adaptation problem still exists…
Generalize Symbolic Knowledge With Neural Rule Engine
Shen Li, Hengru Xu, Zhengdong Lu
As neural networks have dominated the state-of-the-art results in a wide range of NLP tasks, it attracts considerable attention to improve the performance of neural models by integ…
From Random to Supervised: A Novel Dropout Mechanism Integrated with Global Information
Hengru Xu, Shen Li, Renfen Hu +2
Dropout is used to avoid overfitting by randomly dropping units from the neural networks during training. Inspired by dropout, this paper presents GI-Dropout, a novel dropout metho…
Analogical Reasoning on Chinese Morphological and Semantic Relations
Shen Li, Zhe Zhao, Renfen Hu +3
Analogical reasoning is effective in capturing linguistic regularities. This paper proposes an analogical reasoning task on Chinese. After delving into Chinese lexical knowledge, w…