1 citations · 1 across the 5 of their papers we have counts for
6 papers
Evaluating Semantic Relation Knowledge through Bidirectional Relation Prediction from Gloss Pairs
Zhihan Cao, Adam Nohejl, Hitomi Yanaka
Semantic relations organise word senses and are fundamental to lexical semantics. In order to evaluate semantic relation knowledge of large language models (LLMs), we propose a cha…
Relation Geometry in Semantic Space of Language Models
Zhihan Cao, Hiroaki Yamada, Simone Teufel +4
When it comes to generating vector representations of words, current language models are achieving high-quality results. However, what is not known is the extent to which knowledge…
JBE-QA: Japanese Bar Exam QA Dataset for Assessing Legal Domain Knowledge
Zhihan Cao, Fumihito Nishino, Hiroaki Yamada +3
We introduce JBE-QA, a Japanese Bar Exam Question-Answering dataset to evaluate large language models' legal knowledge. Derived from the multiple-choice (tanto-shiki) section of th…
On the Distinctive Co-occurrence Characteristics of Antonymy
Zhihan Cao, Hiroaki Yamada, Takenobu Tokunaga
Antonymy has long received particular attention in lexical semantics. Previous studies have shown that antonym pairs frequently co-occur in text, across genres and parts of speech,…
Misalignment of Semantic Relation Knowledge between WordNet and Human Intuition
Zhihan Cao, Hiroaki Yamada, Simone Teufel +1
WordNet provides a carefully constructed repository of semantic relations, created by specialists. But there is another source of information on semantic relations, the intuition o…
A Comprehensive Evaluation of Semantic Relation Knowledge of Pretrained Language Models and Humans
Zhihan Cao, Hiroaki Yamada, Simone Teufel +1
Recently, much work has concerned itself with the enigma of what exactly pretrained language models~(PLMs) learn about different aspects of language, and how they learn it. One str…