5 citations · 8 across the 8 of their papers we have counts for
3 papers · 1 filter
How does the task complexity of masked pretraining objectives affect downstream performance?
Atsuki Yamaguchi, Hiroaki Ozaki, Terufumi Morishita +2
Masked language modeling (MLM) is a widely used self-supervised pretraining objective, where a model needs to predict an original token that is replaced with a mask given contexts.…
Hitachi at SemEval-2023 Task 3: Exploring Cross-lingual Multi-task Strategies for Genre and Framing Detection in Online News
Yuta Koreeda, Ken-ichi Yokote, Hiroaki Ozaki +3
This paper explains the participation of team Hitachi to SemEval-2023 Task 3 "Detecting the genre, the framing, and the persuasion techniques in online news in a multi-lingual setu…
Controlling keywords and their positions in text generation
Yuichi Sasazawa, Terufumi Morishita, Hiroaki Ozaki +2
One of the challenges in text generation is to control text generation as intended by the user. Previous studies proposed specifying the keywords that should be included in the gen…