activity
20182023
most citedOn the Variance of the Adaptive Learning Rate and Beyond

607 citations · 1.2k across the 25 of their papers we have counts for

collaborators
Showing cs.LGShow all

9 papers · 1 filter

cs.LG2022

DiP-GNN: Discriminative Pre-Training of Graph Neural Networks

Simiao Zuo, Haoming Jiang, Qingyu Yin +3

Graph neural network (GNN) pre-training methods have been proposed to enhance the power of GNNs. Specifically, a GNN is first pre-trained on a large-scale unlabeled graph and then…

cs.LG2022★ 77 cited

Condensing Graphs via One-Step Gradient Matching

Wei Jin, Xianfeng Tang, Haoming Jiang +4

As training deep learning models on large dataset takes a lot of time and resources, it is desired to construct a small synthetic dataset with which we can train deep learning mode…

cs.LG2020★ 16 cited

Deep Reinforcement Learning with Robust and Smooth Policy

Qianli Shen, Yan Li, Haoming Jiang +2

Deep reinforcement learning (RL) has achieved great empirical successes in various domains. However, the large search space of neural networks requires a large amount of data, whic…

cs.LG2020★ 22 cited

Transformer Hawkes Process

Simiao Zuo, Haoming Jiang, Zichong Li +2

Modern data acquisition routinely produce massive amounts of event sequence data in various domains, such as social media, healthcare, and financial markets. These data often exhib…

cs.LG2019★ 10 cited

Meta Learning with Relational Information for Short Sequences

Yujia Xie, Haoming Jiang, Feng Liu +2

This paper proposes a new meta-learning method -- named HARMLESS (HAwkes Relational Meta LEarning method for Short Sequences) for learning heterogeneous point process models from s…

cs.LG2019★ 607 cited

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He +4

The learning rate warmup heuristic achieves remarkable success in stabilizing training, accelerating convergence and improving generalization for adaptive stochastic optimization a…

cs.LG2019★ 3 cited

Nonparametric Regression on Low-Dimensional Manifolds using Deep ReLU Networks : Function Approximation and Statistical Recovery

Minshuo Chen, Haoming Jiang, Wenjing Liao +1

Real world data often exhibit low-dimensional geometric structures, and can be viewed as samples near a low-dimensional manifold. This paper studies nonparametric regression of Höl…

cs.LG2019★ 7 cited

On Scalable and Efficient Computation of Large Scale Optimal Transport

Yujia Xie, Minshuo Chen, Haoming Jiang +2

Optimal Transport (OT) naturally arises in many machine learning applications, yet the heavy computational burden limits its wide-spread uses. To address the scalability issue, we…

cs.LG2018★ 3 cited

On Computation and Generalization of GANs with Spectrum Control

Haoming Jiang, Zhehui Chen, Minshuo Chen +3

Generative Adversarial Networks (GANs), though powerful, is hard to train. Several recent works (brock2016neural,miyato2018spectral) suggest that controlling the spectra of weight…