1.2k citations · 1.8k across the 34 of their papers we have counts for
4 papers · 1 filter
PoNet: Pooling Network for Efficient Token Mixing in Long Sequences
Chao-Hong Tan, Qian Chen, Wen Wang +3
Transformer-based models have achieved great success in various NLP, vision, and speech tasks. However, the core of Transformer, the self-attention mechanism, has a quadratic time…
BeamTransformer: Microphone Array-based Overlapping Speech Detection
Siqi Zheng, Shiliang Zhang, Weilong Huang +5
We propose BeamTransformer, an efficient architecture to leverage beamformer's edge in spatial filtering and transformer's capability in context sequence modeling. BeamTransformer…
Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning
Qian Chen, Wen Wang, Qinglin Zhang
In the traditional cascading architecture for spoken language understanding (SLU), it has been observed that automatic speech recognition errors could be detrimental to the perform…
Discriminative Self-training for Punctuation Prediction
Qian Chen, Wen Wang, Mengzhe Chen +1
Punctuation prediction for automatic speech recognition (ASR) output transcripts plays a crucial role for improving the readability of the ASR transcripts and for improving the per…