21 citations · 34 across the 5 of their papers we have counts for
5 papers
Bidirectional Awareness Induction in Autoregressive Seq2Seq Models
Jia Cheng Hu, Roberto Cavicchioli, Alessandro Capotondi
Autoregressive Sequence-To-Sequence models are the foundation of many Deep Learning achievements in major research fields such as Vision and Natural Language Processing. Despite th…
Heterogeneous Encoders Scaling In The Transformer For Neural Machine Translation
Jia Cheng Hu, Roberto Cavicchioli, Giulia Berardinelli +1
Although the Transformer is currently the best-performing architecture in the homogeneous configuration (self-attention only) in Neural Machine Translation, many State-of-the-Art m…
A request for clarity over the End of Sequence token in the Self-Critical Sequence Training
Jia Cheng Hu, Roberto Cavicchioli, Alessandro Capotondi
The Image Captioning research field is currently compromised by the lack of transparency and awareness over the End-of-Sequence token (<Eos>) in the Self-Critical Sequence Training…
Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning
Jia Cheng Hu, Roberto Cavicchioli, Alessandro Capotondi
We introduce a method called the Expansion mechanism that processes the input unconstrained by the number of elements in the sequence. By doing so, the model can learn more effecti…
Exploring the sequence length bottleneck in the Transformer for Image Captioning
Jia Cheng Hu, Roberto Cavicchioli, Alessandro Capotondi
Most recent state of the art architectures rely on combinations and variations of three approaches: convolutional, recurrent and self-attentive methods. Our work attempts in laying…