activity
20172024
most citedSelfish Sparse RNN Training

16 citations · 56 across the 25 of their papers we have counts for

collaborators

25 papers

cs.LG2024★ 1 cited

Robust Active Learning (RoAL): Countering Dynamic Adversaries in Active Learning with Elastic Weight Consolidation

Ricky Maulana Fajri, Yulong Pei, Lu Yin +1

Despite significant advancements in active learning and adversarial attacks, the intersection of these two fields remains underexplored, particularly in developing robust active le…

cs.CV2024

(PASS) Visual Prompt Locates Good Structure Sparsity through a Recurrent HyperNetwork

Tianjin Huang, Fang Meng, Li Shen +5

Large-scale neural networks have demonstrated remarkable performance in different domains like vision and language processing, although at the cost of massive computation resources…

cs.LG2023

A Structural-Clustering Based Active Learning for Graph Neural Networks

Ricky Maulana Fajri, Yulong Pei, Lu Yin +1

In active learning for graph-structured data, Graph Neural Networks (GNNs) have shown effectiveness. However, a common challenge in these applications is the underutilization of cr…

cs.LG2023

Heterophily-Based Graph Neural Network for Imbalanced Classification

Zirui Liang, Yuntao Li, Tianjin Huang +3

Graph neural networks (GNNs) have shown promise in addressing graph-related problems, including node classification. However, conventional GNNs assume an even distribution of data…

cs.LG2023

MOLE: MOdular Learning FramEwork via Mutual Information Maximization

Tianchao Li, Yulong Pei

This paper is to introduce an asynchronous and local learning framework for neural networks, named Modular Learning Framework (MOLE). This framework modularizes neural networks by…

cs.LG2023

Enhancing Adversarial Training via Reweighting Optimization Trajectory

Tianjin Huang, Shiwei Liu, Tianlong Chen +6

Despite the fact that adversarial training has become the de facto method for improving the robustness of deep neural networks, it is well-known that vanilla adversarial training s…

stat.ML2023

Deep Functional Factor Models: Forecasting High-Dimensional Functional Time Series via Bayesian Nonparametric Factorization

Yirui Liu, Xinghao Qiao, Yulong Pei +1

This paper introduces the Deep Functional Factor Model (DF2M), a Bayesian nonparametric model designed for analysis of high-dimensional functional time series. DF2M is built upon t…

cs.LG2022★ 2 cited

You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Tickets

Tianjin Huang, Tianlong Chen, Meng Fang +8

Recent works have impressively demonstrated that there exists a subnetwork in randomly initialized convolutional neural networks (CNNs) that can match the performance of the fully…

cs.LG2022

FAL-CUR: Fair Active Learning using Uncertainty and Representativeness on Fair Clustering

Ricky Fajri, Akrati Saxena, Yulong Pei +1

Active Learning (AL) techniques have proven to be highly effective in reducing data labeling costs across a range of machine learning tasks. Nevertheless, one known challenge of th…

cs.LG2022★ 2 cited

Superposing Many Tickets into One: A Performance Booster for Sparse Neural Network Training

Lu Yin, Vlado Menkovski, Meng Fang +5

Recent works on sparse neural network training (sparse training) have shown that a compelling trade-off between performance and efficiency can be achieved by training intrinsically…

cs.LG2021

A Comparative Study on Robust Graph Neural Networks to Structural Noises

Zeyu Zhang, Yulong Pei

Graph neural networks (GNNs) learn node representations by passing and aggregating messages between neighboring nodes. GNNs have been applied successfully in several application do…

cs.CV2021

Semantic-Based Few-Shot Learning by Interactive Psychometric Testing

Lu Yin, Vlado Menkovski, Yulong Pei +1

Few-shot classification tasks aim to classify images in query sets based on only a few labeled examples in support sets. Most studies usually assume that each image in a task has a…

cs.LG2021

Calibrated Adversarial Training

Tianjin Huang, Vlado Menkovski, Yulong Pei +1

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of prod…

cs.SI2021

The Banking Transactions Dataset and its Comparative Analysis with Scale-free Networks

Akrati Saxena, Yulong Pei, Jan Veldsink +3

We construct a network of 1.6 million nodes from banking transactions of users of Rabobank. We assign two weights on each edge, which are the aggregate transferred amount and the t…

cs.LG2021

On Generalization of Graph Autoencoders with Adversarial Training

Tianjin Huang, Yulong Pei, Vlado Menkovski +1

Adversarial training is an approach for increasing model's resilience against adversarial perturbations. Such approaches have been demonstrated to result in models with feature rep…

cs.SI2021

A Survey on Role-Oriented Network Embedding

Pengfei Jiao, Xuan Guo, Ting Pan +2

Recently, Network Embedding (NE) has become one of the most attractive research topics in machine learning and data mining. NE approaches have achieved promising performance in var…

cs.LG2021★ 2 cited

Direction-Aggregated Attack for Transferable Adversarial Examples

Tianjin Huang, Vlado Menkovski, Yulong Pei +2

Deep neural networks are vulnerable to adversarial examples that are crafted by imposing imperceptible changes to the inputs. However, these adversarial examples are most successfu…

cs.SI2021★ 4 cited

Hop-Count Based Self-Supervised Anomaly Detection on Attributed Networks

Tianjin Huang, Yulong Pei, Vlado Menkovski +1

Recent years have witnessed an upsurge of interest in the problem of anomaly detection on attributed networks due to its importance in both research and practice. Although various…

cs.LG2021★ 16 cited

Selfish Sparse RNN Training

Shiwei Liu, Decebal Constantin Mocanu, Yulong Pei +1

Sparse neural networks have been widely applied to reduce the computational demands of training and deploying over-parameterized deep neural networks. For inference acceleration, m…

cs.CR2020★ 11 cited

Bridging the Performance Gap between FGSM and PGD Adversarial Training

Tianjin Huang, Vlado Menkovski, Yulong Pei +1

Deep learning achieves state-of-the-art performance in many tasks but exposes to the underlying vulnerability against adversarial examples. Across existing defense techniques, adve…

cs.LG2020★ 7 cited

ResGCN: Attention-based Deep Residual Modeling for Anomaly Detection on Attributed Networks

Yulong Pei, Tianjin Huang, Werner van Ipenburg +1

Effectively detecting anomalous nodes in attributed networks is crucial for the success of many real-world applications such as fraud and intrusion detection. Existing approaches h…

cs.CL2019★ 4 cited

Simultaneous Identification of Tweet Purpose and Position

Rahul Radhakrishnan Iyer, Yulong Pei, Katia Sycara

Tweet classification has attracted considerable attention recently. Most of the existing work on tweet classification focuses on topic classification, which classifies tweets into…

cs.NE2019★ 6 cited

Sparse evolutionary Deep Learning with over one million artificial neurons on commodity hardware

Shiwei Liu, Decebal Constantin Mocanu, Amarsagar Reddy Ramapuram Matavalam +2

Artificial Neural Networks (ANNs) have emerged as hot topics in the research community. Despite the success of ANNs, it is challenging to train and deploy modern ANNs on commodity…

cs.SI2018★ 1 cited

struc2gauss: Structural Role Preserving Network Embedding via Gaussian Embedding

Yulong Pei, Xin Du, Jianpeng Zhang +2

Network embedding (NE) is playing a principal role in network mining, due to its ability to map nodes into efficient low-dimensional embedding vectors. However, two major limitatio…