133 citations · 300 across the 30 of their papers we have counts for
4 papers · 1 filter
RODE: A Radial-Orthogonal Decoupled Engine for Optimization
Guoxiang Xu, Bince Qu, Qi Sun +1
Modern neural network training increasingly uses matrix-aware optimizers, yet their conditioned matrix step is typically added directly to the weight, jointly changing its norm and…
Computational and Storage Efficient Quadratic Neurons for Deep Neural Networks
Chuangtao Chen, Grace Li Zhang, Xunzhao Yin +3
Deep neural networks (DNNs) have been widely deployed across diverse domains such as computer vision and natural language processing. However, the impressive accomplishments of DNN…
GANDSE: Generative Adversarial Network based Design Space Exploration for Neural Network Accelerator Design
Lang Feng, Wenjian Liu, Chuliang Guo +3
With the popularity of deep learning, the hardware implementation platform of deep learning has received increasing interest. Unlike the general purpose devices, e.g., CPU, or GPU,…
When Single Event Upset Meets Deep Neural Networks: Observations, Explorations, and Remedies
Zheyu Yan, Yiyu Shi, Wang Liao +3
Deep Neural Network has proved its potential in various perception tasks and hence become an appealing option for interpretation and data processing in security sensitive systems.…