activity
20162019
most citedCirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matrices

177 citations · 279 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CV2019★ 1 cited

CircConv: A Structured Convolution with Low Complexity

Siyu Liao, Zhe Li, Liang Zhao +3

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the lar…

cs.NE2018

Towards Budget-Driven Hardware Optimization for Deep Convolutional Neural Networks using Stochastic Computing

Zhe Li, Ji Li, Ao Ren +5

Recently, Deep Convolutional Neural Network (DCNN) has achieved tremendous success in many machine learning applications. Nevertheless, the deep structure has brought significant i…

cs.DC2018★ 10 cited

Structured Weight Matrices-Based Hardware Accelerators in Deep Neural Networks: FPGAs and ASICs

Caiwen Ding, Ao Ren, Geng Yuan +5

Both industry and academia have extensively investigated hardware accelerations. In this work, to address the increasing demands in computational capability and memory requirement,…

cs.LG2018★ 21 cited

C-LSTM: Enabling Efficient LSTM using Structured Compression Techniques on FPGAs

Shuo Wang, Zhe Li, Caiwen Ding +4

Recently, significant accuracy improvement has been achieved for acoustic recognition systems by increasing the model size of Long Short-Term Memory (LSTM) networks. Unfortunately,…

cs.LG2018★ 2 cited

On the Universal Approximation Property and Equivalence of Stochastic Computing-based Neural Networks and Binary Neural Networks

Yanzhi Wang, Zheng Zhan, Jiayu Li +6

Large-scale deep neural networks are both memory intensive and computation-intensive, thereby posing stringent requirements on the computing platforms. Hardware accelerations of de…

cs.LG2018★ 14 cited

Towards Ultra-High Performance and Energy Efficiency of Deep Learning Systems: An Algorithm-Hardware Co-Optimization Framework

Yanzhi Wang, Caiwen Ding, Zhe Li +8

Hardware accelerations of deep learning systems have been extensively investigated in industry and academia. The aim of this paper is to achieve ultra-high energy efficiency and pe…

cs.CV2017★ 177 cited

CirCNN: Accelerating and Compressing Deep Neural Networks Using Block-CirculantWeight Matrices

Caiwen Ding, Siyu Liao, Yanzhi Wang +13

Large-scale deep neural networks (DNNs) are both compute and memory intensive. As the size of DNNs continues to grow, it is critical to improve the energy efficiency and performanc…

cs.LG2017★ 19 cited

Theoretical Properties for Neural Networks with Weight Matrices of Low Displacement Rank

Liang Zhao, Siyu Liao, Yanzhi Wang +4

Recently low displacement rank (LDR) matrices, or so-called structured matrices, have been proposed to compress large-scale neural networks. Empirical results have shown that neura…

cs.CV2016★ 35 cited

SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing

Ao Ren, Ji Li, Zhe Li +5

With recent advancing of Internet of Things (IoTs), it becomes very attractive to implement the deep convolutional neural networks (DCNNs) onto embedded/portable systems. Presently…