activity
20192022
most citedHierarchical Self-supervised Augmented Knowledge Distillation

74 citations · 112 across the 19 of their papers we have counts for

collaborators

19 papers

cs.LG2022★ 2 cited

Lifelong Generative Learning via Knowledge Reconstruction

Libo Huang, Zhulin An, Xiang Zhi +1

Generative models often incur the catastrophic forgetting problem when they are used to sequentially learning multiple tasks, i.e., lifelong generative learning. Although there are…

cs.CL2021

Towards Robust Knowledge Graph Embedding via Multi-task Reinforcement Learning

Zhao Zhang, Fuzhen Zhuang, Hengshu Zhu +4

Nowadays, Knowledge graphs (KGs) have been playing a pivotal role in AI-related applications. Despite the large sizes, existing KGs are far from complete and comprehensive. In orde…

cs.CV2021

Knowledge Distillation Using Hierarchical Self-Supervision Augmented Distribution

Chuanguang Yang, Zhulin An, Linhang Cai +1

Knowledge distillation (KD) is an effective framework that aims to transfer meaningful information from a large teacher to a smaller student. Generally, KD often involves how to de…

cs.NI2021

A Channel-Aware Routing Protocol With Nearest Neighbor Regression For Underwater Sensor Networks

Boyu Diao, Chao Li, Qi Wang +2

The underwater acoustic channel is one of the most challenging communication channels. Due to periodical tidal and daily climatic variation, underwater noise is periodically fluctu…

cs.DC2021★ 1 cited

A Distributed SGD Algorithm with Global Sketching for Deep Learning Training Acceleration

LingFei Dai, Boyu Diao, Chao Li +1

Distributed training is an effective way to accelerate the training process of large-scale deep learning models. However, the parameter exchange and synchronization of distributed…

cs.LG2021

Heterogeneous Graph Neural Network with Multi-view Representation Learning

Zezhi Shao, Yongjun Xu, Wei Wei +3

Graph neural networks for heterogeneous graph embedding is to project nodes into a low-dimensional space by exploring the heterogeneity and semantics of the heterogeneous graph. Ho…