39 citations · 119 across the 12 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.LG2021★ 2 cited
Neuron with Steady Response Leads to Better Generalization
Qiang Fu, Lun Du, Haitao Mao +4
Regularization can mitigate the generalization gap between training and inference by introducing inductive bias. Existing works have already proposed various inductive biases from…
cs.LG2021★ 11 cited
GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophily
Lun Du, Xiaozhou Shi, Qiang Fu +4
Graph Neural Networks (GNNs) are widely used on a variety of graph-based machine learning tasks. For node-level tasks, GNNs have strong power to model the homophily property of gra…
cs.LG2021★ 7 cited
Neuron Campaign for Initialization Guided by Information Bottleneck Theory
Haitao Mao, Xu Chen, Qiang Fu +3
Initialization plays a critical role in the training of deep neural networks (DNN). Existing initialization strategies mainly focus on stabilizing the training process to mitigate…