4 papers
What Do Current Systematic Generalization Tasks Miss? A Reasoning-Centered Analysis
Chengwen Qi, Deheng Ye, Yatao Bian
Systematic generalization, the ability to solve novel problems by recombining known atomic elements, is central to human intelligence but difficult to study rigorously under contro…
Self-similarity Analysis in Deep Neural Networks
Jingyi Ding, Chengwen Qi, Hongfei Wang +4
Current research has found that some deep neural networks exhibit strong hierarchical self-similarity in feature representation or parameter distribution. However, aside from preli…
Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation
Chengwen Qi, Ren Ma, Bowen Li +5
First-order logic (FOL) reasoning, which involves sequential deduction, is pivotal for intelligent systems and serves as a valuable task for evaluating reasoning capabilities, part…
An Investigation of LLMs' Inefficacy in Understanding Converse Relations
Chengwen Qi, Bowen Li, Binyuan Hui +4
Large Language Models (LLMs) have achieved remarkable success in many formal language oriented tasks, such as structural data-to-text and semantic parsing. However current benchmar…