979 citations · 1.5k across the 63 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.CL2018
Hierarchical Attention: What Really Counts in Various NLP Tasks
Zehao Dou, Zhihua Zhang
Attention mechanisms in sequence to sequence models have shown great ability and wonderful performance in various natural language processing (NLP) tasks, such as sentence embeddin…
stat.ML2018★ 3 cited
Interpolatron: Interpolation or Extrapolation Schemes to Accelerate Optimization for Deep Neural Networks
Guangzeng Xie, Yitan Wang, Shuchang Zhou +1
In this paper we explore acceleration techniques for large scale nonconvex optimization problems with special focuses on deep neural networks. The extrapolation scheme is a classic…