10 citations · 17 across the 8 of their papers we have counts for
6 papers · 1 filter
Are you doing what I say? On modalities alignment in ALFRED
Ting-Rui Chiang, Yi-Ting Yeh, Ta-Chung Chi +1
ALFRED is a recently proposed benchmark that requires a model to complete tasks in simulated house environments specified by instructions in natural language. We hypothesize that k…
On a Benefit of Mask Language Modeling: Robustness to Simplicity Bias
Ting-Rui Chiang
Despite the success of pretrained masked language models (MLM), why MLM pretraining is useful is still a qeustion not fully answered. In this work we theoretically and empirically…
Breaking Down Multilingual Machine Translation
Ting-Rui Chiang, Yi-Pei Chen, Yi-Ting Yeh +1
While multilingual training is now an essential ingredient in machine translation (MT) systems, recent work has demonstrated that it has different effects in different multilingual…
Relating Neural Text Degeneration to Exposure Bias
Ting-Rui Chiang, Yun-Nung Chen
This work focuses on relating two mysteries in neural-based text generation: exposure bias, and text degeneration. Despite the long time since exposure bias was mentioned and the n…
Improving Dialogue State Tracking by Joint Slot Modeling
Ting-Rui Chiang, Yi-Ting Yeh
Dialogue state tracking models play an important role in a task-oriented dialogue system. However, most of them model the slot types conditionally independently given the input. We…
Why Can You Lay Off Heads? Investigating How BERT Heads Transfer
Ting-Rui Chiang, Yun-Nung Chen
The huge size of the widely used BERT family models has led to recent efforts about model distillation. The main goal of distillation is to create a task-agnostic pre-trained model…