Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
Co-occurrence is not Factual Association in Language Models
Xiao Zhang, Miao Li, Ji Wu
Pretrained language models can encode a large amount of knowledge and utilize it for various reasoning tasks, yet they can still struggle to learn novel factual knowledge effective…
cs.CL2024
Conditional Language Learning with Context
Xiao Zhang, Miao Li, Ji Wu
Language models can learn sophisticated language understanding skills from fitting raw text. They also unselectively learn useless corpus statistics and biases, especially during f…