44 citations · 107 across the 12 of their papers we have counts for
5 papers · 1 filter
On improving deep learning generalization with adaptive sparse connectivity
Shiwei Liu, Decebal Constantin Mocanu, Mykola Pechenizkiy
Large neural networks are very successful in various tasks. However, with limited data, the generalization capabilities of deep neural networks are also very limited. In this paper…
Learning with Delayed Synaptic Plasticity
Anil Yaman, Giovanni Iacca, Decebal Constantin Mocanu +2
The plasticity property of biological neural networks allows them to perform learning and optimize their behavior by changing their configuration. Inspired by biology, plasticity c…
Evolving Plasticity for Autonomous Learning under Changing Environmental Conditions
Anil Yaman, Giovanni Iacca, Decebal Constantin Mocanu +3
A fundamental aspect of learning in biological neural networks is the plasticity property which allows them to modify their configurations during their lifetime. Hebbian learning i…
Intrinsically Sparse Long Short-Term Memory Networks
Shiwei Liu, Decebal Constantin Mocanu, Mykola Pechenizkiy
Long Short-Term Memory (LSTM) has achieved state-of-the-art performances on a wide range of tasks. Its outstanding performance is guaranteed by the long-term memory ability which m…
Sparse evolutionary Deep Learning with over one million artificial neurons on commodity hardware
Shiwei Liu, Decebal Constantin Mocanu, Amarsagar Reddy Ramapuram Matavalam +2
Artificial Neural Networks (ANNs) have emerged as hot topics in the research community. Despite the success of ANNs, it is challenging to train and deploy modern ANNs on commodity…