89 citations · 256 across the 28 of their papers we have counts for
3 papers · 1 filter
On improving deep learning generalization with adaptive sparse connectivity
Shiwei Liu, Decebal Constantin Mocanu, Mykola Pechenizkiy
Large neural networks are very successful in various tasks. However, with limited data, the generalization capabilities of deep neural networks are also very limited. In this paper…
Intrinsically Sparse Long Short-Term Memory Networks
Shiwei Liu, Decebal Constantin Mocanu, Mykola Pechenizkiy
Long Short-Term Memory (LSTM) has achieved state-of-the-art performances on a wide range of tasks. Its outstanding performance is guaranteed by the long-term memory ability which m…
Sparse evolutionary Deep Learning with over one million artificial neurons on commodity hardware
Shiwei Liu, Decebal Constantin Mocanu, Amarsagar Reddy Ramapuram Matavalam +2
Artificial Neural Networks (ANNs) have emerged as hot topics in the research community. Despite the success of ANNs, it is challenging to train and deploy modern ANNs on commodity…