3.7k citations · 8k across the 129 of their papers we have counts for
19 papers · 1 filter
On Training Implicit Models
Zhengyang Geng, Xin-Yu Zhang, Shaojie Bai +2
This paper focuses on training implicit models of infinite layers. Specifically, previous works employ implicit differentiation and solve the exact gradient for the backward propag…
Pareto Adversarial Robustness: Balancing Spatial Robustness and Sensitivity-based Robustness
Ke Sun, Mingjie Li, Zhouchen Lin
Adversarial robustness, which primarily comprises sensitivity-based robustness and spatial robustness, plays an integral part in achieving robust generalization. In this paper, we…
Residual Relaxation for Multi-view Representation Learning
Yifei Wang, Zhengyang Geng, Feng Jiang +4
Multi-view methods learn representations by aligning multiple views of the same image and their performance largely depends on the choice of data augmentation. In this paper, we no…
Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State
Mingqing Xiao, Qingyan Meng, Zongpeng Zhang +2
Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a ha…
Is Attention Better Than Matrix Decomposition?
Zhengyang Geng, Meng-Hao Guo, Hongxu Chen +3
As an essential ingredient of modern deep learning, attention mechanism, especially self-attention, plays a vital role in the global correlation discovery. However, is hand-crafted…
Under-bagging Nearest Neighbors for Imbalanced Classification
Hanyuan Hang, Yuchao Cai, Hanfang Yang +1
In this paper, we propose an ensemble learning algorithm called \textit{under-bagging -nearest neighbors} (\textit{under-bagging -NN}) for imbalanced classification problems.…