28 citations · 40 across the 17 of their papers we have counts for
5 papers · 1 filter
Semantic-Aware Local-Global Vision Transformer
Jiatong Zhang, Zengwei Yao, Fanglin Chen +2
Vision Transformers have achieved remarkable progresses, among which Swin Transformer has demonstrated the tremendous potential of Transformer for vision tasks. It surmounts the ke…
Predicting Multi-Codebook Vector Quantization Indexes for Knowledge Distillation
Liyong Guo, Xiaoyu Yang, Quandong Wang +9
Knowledge distillation(KD) is a common approach to improve model performance in automatic speech recognition (ASR), where a student model is trained to imitate the output behaviour…
Delay-penalized transducer for low-latency streaming ASR
Wei Kang, Zengwei Yao, Fangjun Kuang +5
In streaming automatic speech recognition (ASR), it is desirable to reduce latency as much as possible while having minimum impact on recognition accuracy. Although a few existing…
Fast and parallel decoding for transducer
Wei Kang, Liyong Guo, Fangjun Kuang +6
The transducer architecture is becoming increasingly popular in the field of speech recognition, because it is naturally streaming as well as high in accuracy. One of the drawbacks…
Pruned RNN-T for fast, memory-efficient ASR training
Fangjun Kuang, Liyong Guo, Wei Kang +4
The RNN-Transducer (RNN-T) framework for speech recognition has been growing in popularity, particularly for deployed real-time ASR systems, because it combines high accuracy with…