1 citations · 1 across the 10 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.CL2024
Neuron Empirical Gradient: Discovering and Quantifying Neurons Global Linear Controllability
Xin Zhao, Zehui Jiang, Naoki Yoshinaga
While feed-forward neurons in pre-trained language models (PLMs) can encode knowledge, past research targeted a small subset of neurons that heavily influence outputs. This leaves…
cs.CL2024
What Matters in Memorizing and Recalling Facts? Multifaceted Benchmarks for Knowledge Probing in Language Models
Xin Zhao, Naoki Yoshinaga, Daisuke Oba
Language models often struggle with handling factual knowledge, exhibiting factual hallucination issue. This makes it vital to evaluate the models' ability to recall its parametric…
cs.CL2024★ 1 cited
Tracing the Roots of Facts in Multilingual Language Models: Independent, Shared, and Transferred Knowledge
Xin Zhao, Naoki Yoshinaga, Daisuke Oba
Acquiring factual knowledge for language models (LMs) in low-resource languages poses a serious challenge, thus resorting to cross-lingual transfer in multilingual LMs (ML-LMs). In…