7 citations · 34 across the 16 of their papers we have counts for
4 papers · 1 filter
A Survey on Semantic Processing Techniques
Rui Mao, Kai He, Xulang Zhang +4
Semantic processing is a fundamental research domain in computational linguistics. In the era of powerful pre-trained language models and large language models, the advancement of…
Large Language Models for Automated Open-domain Scientific Hypotheses Discovery
Zonglin Yang, Xinya Du, Junxian Li +3
Hypothetical induction is recognized as the main reasoning type when scientists make observations about the world and try to propose hypotheses to explain those observations. Past…
Finding the Pillars of Strength for Multi-Head Attention
Jinjie Ni, Rui Mao, Zonglin Yang +2
Recent studies have revealed some issues of Multi-Head Attention (MHA), e.g., redundancy and over-parameterization. Specifically, the heads of MHA were originally designed to atten…
Logical Reasoning over Natural Language as Knowledge Representation: A Survey
Zonglin Yang, Xinya Du, Rui Mao +2
Logical reasoning is central to human cognition and intelligence. It includes deductive, inductive, and abductive reasoning. Past research of logical reasoning within AI uses forma…