2.4k citations · 5k across the 21 of their papers we have counts for
5 papers · 1 filter
Positional Normalization
Boyi Li, Felix Wu, Kilian Q. Weinberger +1
A popular method to reduce the training time of deep neural networks is to normalize activations at each layer. Although various normalization schemes have been proposed, they all…
BERTScore: Evaluating Text Generation with BERT
Tianyi Zhang, Varsha Kishore, Felix Wu +2
We propose BERTScore, an automatic evaluation metric for text generation. Analogously to common metrics, BERTScore computes a similarity score for each token in the candidate sente…
FastFusionNet: New State-of-the-Art for DAWNBench SQuAD
Felix Wu, Boyi Li, Lequn Wang +3
In this technical report, we introduce FastFusionNet, an efficient variant of FusionNet [12]. FusionNet is a high performing reading comprehension architecture, which was designed…
Pay Less Attention with Lightweight and Dynamic Convolutions
Felix Wu, Angela Fan, Alexei Baevski +2
Self-attention is a useful mechanism to build generative models for language and images. It determines the importance of context elements by comparing each element to the current t…
Simplifying Graph Convolutional Networks
Felix Wu, Tianyi Zhang, Amauri Holanda de Souza +3
Graph Convolutional Networks (GCNs) and their variants have experienced significant attention and have become the de facto methods for learning graph representations. GCNs derive i…