Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Chunk-wise Attention Transducers for Fast and Accurate Streaming Speech-to-Text
Hainan Xu, Vladimir Bataev, Travis M. Bartley +1
We propose Chunk-wise Attention Transducer (CHAT), a novel extension to RNN-T models that processes audio in fixed-size chunks while employing cross-attention within each chunk. Th…
cs.LG2025
WIND: Accelerated RNN-T Decoding with Windowed Inference for Non-blank Detection
Hainan Xu, Vladimir Bataev, Lilit Grigoryan +1
We propose Windowed Inference for Non-blank Detection (WIND), a novel strategy that significantly accelerates RNN-T inference without compromising model accuracy. During model infe…