2.3k citations · 4.9k across the 9 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
cs.LG2016★ 516 cited
Training Deep Nets with Sublinear Memory Cost
Tianqi Chen, Bing Xu, Chiyuan Zhang +1
We propose a systematic approach to reduce the memory consumption of deep neural network training. Specifically, we design an algorithm that costs O(sqrt(n)) memory to train a n la…
cs.LG2016★ 44 cited
Revise Saturated Activation Functions
Bing Xu, Ruitong Huang, Mu Li
In this paper, we revise two commonly used saturated functions, the logistic sigmoid and the hyperbolic tangent (tanh). We point out that, besides the well-known non-zero centered…