553 citations · 1.6k across the 70 of their papers we have counts for
Showing 2017Show all
3 papers · 1 filter
cs.LG2017★ 14 cited
Projection Based Weight Normalization for Deep Neural Networks
Lei Huang, Xianglong Liu, Bo Lang +1
Optimizing deep neural networks (DNNs) often suffers from the ill-conditioned problem. We observe that the scaling-based weight space symmetry property in rectified nonlinear netwo…
cs.LG2017★ 90 cited
Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks
Lei Huang, Xianglong Liu, Bo Lang +3
Orthogonal matrix has shown advantages in training Recurrent Neural Networks (RNNs), but such matrix is limited to be square for the hidden-to-hidden transformation in RNNs. In thi…
cs.CV2017★ 25 cited
Deep Sketch Hashing: Fast Free-hand Sketch-Based Image Retrieval
Li Liu, Fumin Shen, Yuming Shen +2
Free-hand sketch-based image retrieval (SBIR) is a specific cross-view retrieval task, in which queries are abstract and ambiguous sketches while the retrieval database is formed w…