644 citations · 782 across the 16 of their papers we have counts for
4 papers · 1 filter
SRU++: Pioneering Fast Recurrence with Attention for Speech Recognition
Jing Pan, Tao Lei, Kwangyoun Kim +2
The Transformer architecture has been well adopted as a dominant architecture in most sequence transduction tasks including automatic speech recognition (ASR), since its attention…
Nutribullets Hybrid: Multi-document Health Summarization
Darsh J Shah, Lili Yu, Tao Lei +1
We present a method for generating comparative summaries that highlights similarities and contradictions in input documents. The key challenge in creating such summaries is the lac…
Nutri-bullets: Summarizing Health Studies by Composing Segments
Darsh J Shah, Lili Yu, Tao Lei +1
We introduce \emph{Nutri-bullets}, a multi-document summarization task for health and nutrition. First, we present two datasets of food and health summaries from multiple scientifi…
When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute
Tao Lei
Large language models have become increasingly difficult to train because of the growing computation time and cost. In this work, we present SRU++, a highly-efficient architecture…