Publications (139)
Langsmith: An Interactive Academic Text Revision System
Takumi Ito, Tatsuki Kuribayashi, Masatoshi Hidaka +2
Despite the current diversity and inclusion initiatives in the academic community, researchers with a non-native command of English still face significant obstacles when writing pa…
A Corpus of Deep Argumentative Structures as an Explanation to Argumentative Relations
Paul Reisert, Naoya Inoue, Naoaki Okazaki +1
In this paper, we compose a new task for deep argumentative structure analysis that goes beyond shallow discourse structure analysis. The idea is that argumentative relations can r…
Understanding Fact Recall in Language Models: Why Two-Stage Training Encourages Memorization but Mixed Training Teaches Knowledge
Ying Zhang, Benjamin Heinzerling, Dongyuan Li +1
While fine-tuning is the standard for injecting factual knowledge into large language models (LLMs), the mechanisms enabling reliable fact recall via unseen queries remain poorly u…
Uncovering the Spectral Bias in Diagonal State Space Models
Ruben Solozabal, Velibor Bojkovic, Hilal AlQuabeh +2
Current methods for initializing state space models (SSMs) parameters mainly rely on the \textit{HiPPO framework}, which is based on an online approximation of orthogonal polynomia…
Corruption Is Not All Bad: Incorporating Discourse Structure into Pre-training via Corruption for Essay Scoring
Farjana Sultana Mim, Naoya Inoue, Paul Reisert +2
Existing approaches for automated essay scoring and document representation learning typically rely on discourse parsers to incorporate discourse structure into text representation…
Chat Translation Error Detection for Assisting Cross-lingual Communications
Yunmeng Li, Jun Suzuki, Makoto Morishita +4
In this paper, we describe the development of a communication support system that detects erroneous translations to facilitate crosslingual communications due to the limitations of…