619 citations · 733 across the 14 of their papers we have counts for
24 papers
Adaptive Training Distributions with Scalable Online Bilevel Optimization
David Grangier, Pierre Ablin, Awni Hannun
Large neural networks pretrained on web-scale corpora are central to modern machine learning. In this paradigm, the distribution of the large, heterogeneous pretraining data rarely…
Star Temporal Classification: Sequence Classification with Partially Labeled Data
Vineel Pratap, Awni Hannun, Gabriel Synnaeve +1
We develop an algorithm which can learn from partially labeled and unsegmented sequential data. Most sequential loss functions, such as Connectionist Temporal Classification (CTC),…
Parallel Composition of Weighted Finite-State Transducers
Shubho Sengupta, Vineel Pratap, Awni Hannun
Finite-state transducers (FSTs) are frequently used in speech recognition. Transducer composition is an essential operation for combining different sources of information at differ…
The History of Speech Recognition to the Year 2030
Awni Hannun
The decade from 2010 to 2020 saw remarkable improvements in automatic speech recognition. Many people now use speech recognition on a daily basis, for example to perform voice sear…
The Role of Evolution in Machine Intelligence
Awni Hannun
Machine intelligence can develop either directly from experience or by inheriting experience through evolution. The bulk of current research efforts focus on algorithms which learn…
Gradient Matching for Domain Generalization
Yuge Shi, Jeffrey Seely, Philip H. S. Torr +4
Machine learning systems typically assume that the distributions of training and test sets match closely. However, a critical requirement of such systems in the real world is their…