4 papers
Analysis of the Neglect-Zero Effect in Large Language Models
Jin Tanaka, Daiki Matsuoka, Ryoma Kumon +1
We investigate the extent to which the language processing of LLMs resembles human cognitive processes, focusing on a human cognitive bias called the …
Implementing a Logical Inference System for Japanese Comparatives
Yosuke Mikami, Daiki Matsuoka, Hitomi Yanaka
Natural Language Inference (NLI) involving comparatives is challenging because it requires understanding quantities and comparative relations expressed by sentences. While some app…
Can Large Language Models Robustly Perform Natural Language Inference for Japanese Comparatives?
Yosuke Mikami, Daiki Matsuoka, Hitomi Yanaka
Large Language Models (LLMs) perform remarkably well in Natural Language Inference (NLI). However, NLI involving numerical and logical expressions remains challenging. Comparatives…
Evaluating Structural Generalization in Neural Machine Translation
Ryoma Kumon, Daiki Matsuoka, Hitomi Yanaka
Compositional generalization refers to the ability to generalize to novel combinations of previously observed words and syntactic structures. Since it is regarded as a desired prop…