activity
20192025
most citedA Survey on Model Compression for Large Language Models

37 citations · 97 across the 26 of their papers we have counts for

collaborators
Showing cs.LGShow all

21 papers · 1 filter

cs.LG2025

Multi-Modal Molecular Representation Learning via Structure Awareness

Rong Yin, Ruyue Liu, Xiaoshuai Hao +4

Accurate extraction of molecular representations is a critical step in the drug discovery process. In recent years, significant progress has been made in molecular representation l…

cs.LG2025

AS-GCL: Asymmetric Spectral Augmentation on Graph Contrastive Learning

Ruyue Liu, Rong Yin, Yong Liu +4

Graph Contrastive Learning (GCL) has emerged as the foremost approach for self-supervised learning on graph-structured data. GCL reduces reliance on labeled data by learning robust…

cs.LG2024

Communication-Efficient Personalized Federal Graph Learning via Low-Rank Decomposition

Ruyue Liu, Rong Yin, Xiangzhen Bo +5

Federated graph learning (FGL) has gained significant attention for enabling heterogeneous clients to process their private graph data locally while interacting with a centralized…

cs.LG2024

FedNS: A Fast Sketching Newton-Type Algorithm for Federated Learning

Jian Li, Yong Liu, Wei Wang +2

Recent Newton-type federated learning algorithms have demonstrated linear convergence with respect to the communication rounds. However, communicating Hessian matrices is often unf…

cs.LG2023★ 6 cited

ASWT-SGNN: Adaptive Spectral Wavelet Transform-based Self-Supervised Graph Neural Network

Ruyue Liu, Rong Yin, Yong Liu +1

Graph Comparative Learning (GCL) is a self-supervised method that combines the advantages of Graph Convolutional Networks (GCNs) and comparative learning, making it promising for l…

cs.LG2023★ 1 cited

Robust Neural Architecture Search

Xunyu Zhu, Jian Li, Yong Liu +1

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks.…

cs.LG2022★ 1 cited

Sharper Utility Bounds for Differentially Private Models

Yilin Kang, Yong Liu, Jian Li +1

In this paper, by introducing Generalized Bernstein condition, we propose the first high probability excess population risk bound for dif…

cs.LG2022

Stability and Generalization of Differentially Private Minimax Problems

Yilin Kang, Yong Liu, Jian Li +1

In the field of machine learning, many problems can be formulated as the minimax problem, including reinforcement learning, generative adversarial networks, to just name a few. So…

cs.LG2021

Towards Sharper Utility Bounds for Differentially Private Pairwise Learning

Yilin Kang, Yong Liu, Jian Li +1

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of sam…

cs.LG2020★ 9 cited

Neural Architecture Optimization with Graph VAE

Jian Li, Yong Liu, Jiankun Liu +1

Due to their high computational efficiency on a continuous space, gradient optimization methods have shown great potential in the neural architecture search (NAS) domain. The mappi…

cs.LG2020

Theoretical Analysis of Divide-and-Conquer ERM: Beyond Square Loss and RKHS

Yong Liu, Lizhong Ding, Weiping Wang

Theoretical analysis of the divide-and-conquer based distributed learning with least square loss in the reproducing kernel Hilbert space (RKHS) have recently been explored within t…

cs.LG2020★ 1 cited

Nearly Optimal Clustering Risk Bounds for Kernel K-Means

Yong Liu, Lizhong Ding, Weiping Wang

In this paper, we study the statistical properties of kernel -means and obtain a nearly optimal excess clustering risk bound, substantially improving the state-of-art bounds in…

cs.LG2020★ 1 cited

Convolutional Spectral Kernel Learning

Jian Li, Yong Liu, Weiping Wang

Recently, non-stationary spectral kernels have drawn much attention, owing to its powerful feature representation ability in revealing long-range correlations and input-dependent c…

cs.LG2020★ 10 cited

Input Perturbation: A New Paradigm between Central and Local Differential Privacy

Yilin Kang, Yong Liu, Ben Niu +3

Traditionally, there are two models on differential privacy: the central model and the local model. The central model focuses on the machine learning model and the local model focu…

cs.LG2020

Data Heterogeneity Differential Privacy: From Theory to Algorithm

Yilin Kang, Jian Li, Yong Liu +1

Traditionally, the random noise is equally injected when training with different data instances in the field of differential privacy (DP). In this paper, we first give sharper exce…

cs.LG2019★ 9 cited

Weighted Distributed Differential Privacy ERM: Convex and Non-convex

Yilin Kang, Yong Liu, Weiping Wang

Distributed machine learning is an approach allowing different parties to learn a model over all data sets without disclosing their own data. In this paper, we propose a weighted d…

cs.LG2019★ 12 cited

Automated Spectral Kernel Learning

Jian Li, Yong Liu, Weiping Wang

The generalization performance of kernel methods is largely determined by the kernel, but common kernels are stationary thus input-independent and output-independent, that limits t…

cs.LG2019★ 3 cited

Semi-supervised Vector-valued Learning: Improved Bounds and Algorithms

Jian Li, Yong Liu, Weiping Wang

Vector-valued learning, where the output space admits a vector-valued structure, is an important problem that covers a broad family of important domains, e.g. multi-task learning a…

cs.LG2019★ 2 cited

Towards Sharp Analysis for Distributed Learning with Random Features

Jian Li, Yong Liu, Weiping Wang

In recent studies, the generalization properties for distributed learning and random features assumed the existence of the target concept over the hypothesis space. However, this s…

cs.LG2019★ 1 cited

Efficient Cross-Validation for Semi-Supervised Learning

Yong Liu, Jian Li, Guangjun Wu +2

Manifold regularization, such as laplacian regularized least squares (LapRLS) and laplacian support vector machine (LapSVM), has been widely used in semi-supervised learning, and i…

cs.LG2019

Max-Diversity Distributed Learning: Theory and Algorithms

Yong Liu, Jian Li, Weiping Wang

We study the risk performance of distributed learning for the regularization empirical risk minimization with fast convergence rate, substantially improving the error analysis of t…