From the 1 of 5 linked papers with an AI index.
5 papers
Relation Geometry in Semantic Space of Language Models
Zhihan Cao, Hiroaki Yamada, Simone Teufel +4
The paper investigates how different semantic relations are reflected in the geometric structure of word embedding spaces produced by various language models, examining region clus…
JBE-QA: Japanese Bar Exam QA Dataset for Assessing Legal Domain Knowledge
Zhihan Cao, Fumihito Nishino, Hiroaki Yamada +3
We introduce JBE-QA, a Japanese Bar Exam Question-Answering dataset to evaluate large language models' legal knowledge. Derived from the multiple-choice (tanto-shiki) section of th…
On the Distinctive Co-occurrence Characteristics of Antonymy
Zhihan Cao, Hiroaki Yamada, Takenobu Tokunaga
Antonymy has long received particular attention in lexical semantics. Previous studies have shown that antonym pairs frequently co-occur in text, across genres and parts of speech,…
A Comprehensive Evaluation of Semantic Relation Knowledge of Pretrained Language Models and Humans
Zhihan Cao, Hiroaki Yamada, Simone Teufel +1
Recently, much work has concerned itself with the enigma of what exactly pretrained language models~(PLMs) learn about different aspects of language, and how they learn it. One str…
Misalignment of Semantic Relation Knowledge between WordNet and Human Intuition
Zhihan Cao, Hiroaki Yamada, Simone Teufel +1
WordNet provides a carefully constructed repository of semantic relations, created by specialists. But there is another source of information on semantic relations, the intuition o…