2 papers
cs.CL2021
Task-adaptive Pre-training of Language Models with Word Embedding Regularization
Kosuke Nishida, Kyosuke Nishida, Sen Yoshida
Pre-trained language models (PTLMs) acquire domain-independent linguistic knowledge through pre-training with massive textual resources. Additional pre-training is effective in ada…
cs.CL2021
VisualMRC: Machine Reading Comprehension on Document Images
Ryota Tanaka, Kyosuke Nishida, Sen Yoshida
Recent studies on machine reading comprehension have focused on text-level understanding but have not yet reached the level of human understanding of the visual layout and content…