activity
20142025
most citedSpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition

3.6k citations · 10.6k across the 54 of their papers we have counts for

collaborators
Showing 2022Show all

5 papers · 1 filter

cs.CV2022

LidarAugment: Searching for Scalable 3D LiDAR Data Augmentations

Zhaoqi Leng, Guowang Li, Chenxi Liu +5

Data augmentations are important in training high-performance 3D object detectors for point clouds. Despite recent efforts on designing new data augmentations, perhaps surprisingly…

cs.LG2022

What does a deep neural network confidently perceive? The effective dimension of high certainty class manifolds and their low confidence boundaries

Stanislav Fort, Ekin Dogus Cubuk, Surya Ganguli +1

Deep neural network classifiers partition input space into high confidence regions for each class. The geometry of these class manifolds (CMs) is widely studied and intimately rela…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…

cs.CV2022★ 85 cited

PolyLoss: A Polynomial Expansion Perspective of Classification Loss Functions

Zhaoqi Leng, Mingxing Tan, Chenxi Liu +4

Cross-entropy loss and focal loss are the most common choices when training deep neural networks for classification problems. Generally speaking, however, a good loss function can…

cs.CV2022★ 13 cited

Do better ImageNet classifiers assess perceptual similarity better?

Manoj Kumar, Neil Houlsby, Nal Kalchbrenner +1

Perceptual distances between images, as measured in the space of pre-trained deep features, have outperformed prior low-level, pixel-based metrics on assessing perceptual similarit…