activity
20172022
most citedAdditive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks

121 citations · 193 across the 16 of their papers we have counts for

collaborators
Showing cs.LGShow all

10 papers · 1 filter

cs.LG2022★ 1 cited

SphereFed: Hyperspherical Federated Learning

Xin Dong, Sai Qian Zhang, Ang Li +1

Federated Learning aims at training a global model from multiple decentralized devices (i.e. clients) without exchanging their private local data. A key challenge is the handling o…

cs.LG2022★ 1 cited

SplitNets: Designing Neural Architectures for Efficient Distributed Computing on Head-Mounted Systems

Xin Dong, Barbara De Salvo, Meng Li +4

We design deep neural networks (DNNs) and corresponding networks' splittings to distribute DNNs' workload to camera sensors and a centralized aggregator on head mounted devices to…

cs.LG2021★ 22 cited

A Free Lunch From ANN: Towards Efficient, Accurate Spiking Neural Networks Calibration

Yuhang Li, Shikuang Deng, Xin Dong +2

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the…

cs.LG2021★ 2 cited

Neural Mean Discrepancy for Efficient Out-of-Distribution Detection

Xin Dong, Junfeng Guo, Ang Li +3

Various approaches have been proposed for out-of-distribution (OOD) detection by augmenting models, input examples, training sets, and optimization objectives. Deviating from exist…

cs.LG2020

MixMix: All You Need for Data-Free Compression Are Feature and Data Mixing

Yuhang Li, Feng Zhu, Ruihao Gong +5

User data confidentiality protection is becoming a rising challenge in the present deep learning research. Without access to data, conventional data-driven model compression faces…

cs.LG2020★ 13 cited

Efficient Bitwidth Search for Practical Mixed Precision Neural Network

Yuhang Li, Wei Wang, Haoli Bai +3

Network quantization has rapidly become one of the most widely used methods to compress and accelerate deep neural networks. Recent efforts propose to quantize weights and activati…

cs.LG2019★ 2 cited

RTN: Reparameterized Ternary Network

Yuhang Li, Xin Dong, Sai Qian Zhang +3

To deploy deep neural networks on resource-limited devices, quantization has been widely explored. In this work, we study the extremely low-bit networks which have tremendous speed…

cs.LG2019★ 121 cited

Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks

Yuhang Li, Xin Dong, Wei Wang

We propose Additive Powers-of-Two~(APoT) quantization, an efficient non-uniform quantization scheme for the bell-shaped and long-tailed distribution of weights and activations in n…

cs.LG2019

Full-stack Optimization for Accelerating CNNs with FPGA Validation

Bradley McDanel, Sai Qian Zhang, H. T. Kung +1

We present a full-stack optimization framework for accelerating inference of CNNs (Convolutional Neural Networks) and validate the approach with field-programmable gate arrays (FPG…

cs.LG2018★ 15 cited

Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit?

Shilin Zhu, Xin Dong, Hao Su

Binary neural networks (BNN) have been studied extensively since they run dramatically faster at lower memory and power consumption than floating-point networks, thanks to the effi…