67 citations · 339 across the 48 of their papers we have counts for
9 papers · 1 filter
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps
Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara +1
A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question. However, curren…
Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systems
Vitou Phy, Yang Zhao, Akiko Aizawa
Many automatic evaluation metrics have been proposed to score the overall quality of a response in open-domain dialogue. Generally, the overall quality is comprised of various aspe…
A Linguistic Analysis of Visually Grounded Dialogues Based on Spatial Expressions
Takuma Udagawa, Takato Yamazaki, Akiko Aizawa
Recent models achieve promising results in visually grounded dialogues. However, existing datasets often contain undesirable biases and lack sophisticated linguistic analyses, whic…
A System for Worldwide COVID-19 Information Aggregation
Akiko Aizawa, Frederic Bergeron, Junjie Chen +26
The global pandemic of COVID-19 has made the public pay close attention to related news, covering various domains, such as sanitation, treatment, and effects on education. Meanwhil…
Extraction and Evaluation of Formulaic Expressions Used in Scholarly Papers
Kenichi Iwatsuki, Florian Boudin, Akiko Aizawa
Formulaic expressions, such as 'in this paper we propose', are helpful for authors of scholarly papers because they convey communicative functions; in the above, it is showing the…
Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
Question answering (QA) models for reading comprehension have achieved human-level accuracy on in-distribution test sets. However, they have been demonstrated to lack robustness to…
Benchmarking Machine Reading Comprehension: A Psychological Perspective
Saku Sugawara, Pontus Stenetorp, Akiko Aizawa
Machine reading comprehension (MRC) has received considerable attention as a benchmark for natural language understanding. However, the conventional task design of MRC lacks explai…
Discovering Mathematical Objects of Interest -- A Study of Mathematical Notations
Andre Greiner-Petter, Moritz Schubotz, Fabian Mueller +4
Mathematical notation, i.e., the writing system used to communicate concepts in mathematics, encodes valuable information for a variety of information search and retrieval systems.…
From Natural Language Instructions to Complex Processes: Issues in Chaining Trigger Action Rules
Nobuhiro Ito, Yuya Suzuki, Akiko Aizawa
Automation services for complex business processes usually require a high level of information technology literacy. There is a strong demand for a smartly assisted process automati…