95 citations · 309 across the 11 of their papers we have counts for
12 papers
Switch-BERT: Learning to Model Multimodal Interactions by Switching Attention and Input
Qingpei Guo, Kaisheng Yao, Wei Chu
The ability to model intra-modal and inter-modal interactions is fundamental in multimodal machine learning. The current state-of-the-art models usually adopt deep learning models…
Zero-Shot End-to-End Spoken Language Understanding via Cross-Modal Selective Self-Training
Jianfeng He, Julian Salazar, Kaisheng Yao +2
End-to-end (E2E) spoken language understanding (SLU) is constrained by the cost of collecting speech-semantics pairs, especially when label domains change. Hence, we explore \texti…
Neural Sequence Segmentation as Determining the Leftmost Segments
Yangming Li, Lemao Liu, Kaisheng Yao
Prior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In…
Interpretable NLG for Task-oriented Dialogue Systems with Heterogeneous Rendering Machines
Yangming Li, Kaisheng Yao
End-to-end neural networks have achieved promising performances in natural language generation (NLG). However, they are treated as black boxes and lack interpretability. To address…
Rewriter-Evaluator Architecture for Neural Machine Translation
Yangming Li, Kaisheng Yao
Encoder-decoder has been widely used in neural machine translation (NMT). A few methods have been proposed to improve it with multiple passes of decoding. However, their full poten…
An Attentional Neural Conversation Model with Improved Specificity
Kaisheng Yao, Baolin Peng, Geoffrey Zweig +1
In this paper we propose a neural conversation model for conducting dialogues. We demonstrate the use of this model to generate help desk responses, where users are asking question…