49 citations · 171 across the 23 of their papers we have counts for
23 papers
Towards Accelerated Model Training via Bayesian Data Selection
Zhijie Deng, Peng Cui, Jun Zhu
Mislabeled, duplicated, or biased data in real-world scenarios can lead to prolonged training and even hinder model convergence. Traditional solutions prioritizing easy or hard sam…
Rethinking Distribution Shifts: Empirical Analysis and Modeling for Tabular Data
Tianyu Wang, Jiashuo Liu, Peng Cui +1
Different distribution shifts require different interventions, and algorithms must be grounded in the specific shifts they address. However, methodological development for robust a…
Inductive Meta-path Learning for Schema-complex Heterogeneous Information Networks
Shixuan Liu, Changjun Fan, Kewei Cheng +4
Heterogeneous Information Networks (HINs) are information networks with multiple types of nodes and edges. The concept of meta-path, i.e., a sequence of entity types and relation t…
Meta Adaptive Task Sampling for Few-Domain Generalization
Zheyan Shen, Han Yu, Peng Cui +4
To ensure the out-of-distribution (OOD) generalization performance, traditional domain generalization (DG) methods resort to training on data from multiple sources with different u…
RecurrentGPT: Interactive Generation of (Arbitrarily) Long Text
Wangchunshu Zhou, Yuchen Eleanor Jiang, Peng Cui +5
The fixed-size context of Transformer makes GPT models incapable of generating arbitrarily long text. In this paper, we introduce RecurrentGPT, a language-based simulacrum of the r…
Exploring and Exploiting Data Heterogeneity in Recommendation
Zimu Wang, Jiashuo Liu, Hao Zou +4
Massive amounts of data are the foundation of data-driven recommendation models. As an inherent nature of big data, data heterogeneity widely exists in real-world recommendation sy…
Rethinking the Evaluation Protocol of Domain Generalization
Han Yu, Xingxuan Zhang, Renzhe Xu +3
Domain generalization aims to solve the challenge of Out-of-Distribution (OOD) generalization by leveraging common knowledge learned from multiple training domains to generalize to…
Learning Sample Difficulty from Pre-trained Models for Reliable Prediction
Peng Cui, Dan Zhang, Zhijie Deng +2
Large-scale pre-trained models have achieved remarkable success in many applications, but how to leverage them to improve the prediction reliability of downstream models is undesir…
Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization
Xingxuan Zhang, Renzhe Xu, Han Yu +2
Recently, flat minima are proven to be effective for improving generalization and sharpness-aware minimization (SAM) achieves state-of-the-art performance. Yet the current definiti…
Confidence-based Reliable Learning under Dual Noises
Peng Cui, Yang Yue, Zhijie Deng +1
Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet,…
Model Agnostic Sample Reweighting for Out-of-Distribution Learning
Xiao Zhou, Yong Lin, Renjie Pi +4
Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of…
Stable Learning via Sparse Variable Independence
Han Yu, Peng Cui, Yue He +4
The problem of covariate-shift generalization has attracted intensive research attention. Previous stable learning algorithms employ sample reweighting schemes to decorrelate the c…
Neural Eigenfunctions Are Structured Representation Learners
Zhijie Deng, Jiaxin Shi, Hao Zhang +3
This paper introduces a structured, adaptive-length deep representation called Neural Eigenmap. Unlike prior spectral methods such as Laplacian Eigenmap that operate in a nonparame…
Enhancing Distributional Stability among Sub-populations
Jiashuo Liu, Jiayun Wu, Jie Peng +4
Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal lear…
A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protection
Bingzhe Wu, Jintang Li, Junchi Yu +17
Deep graph learning has achieved remarkable progresses in both business and scientific areas ranging from finance and e-commerce, to drug and advanced material discovery. Despite t…
NICO++: Towards Better Benchmarking for Domain Generalization
Xingxuan Zhang, Yue He, Renzhe Xu +3
Despite the remarkable performance that modern deep neural networks have achieved on independent and identically distributed (I.I.D.) data, they can crash under distribution shifts…
A Roadmap for Big Model
Sha Yuan, Hanyu Zhao, Shuai Zhao +97
With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm. Researchers have achieved various outcomes in the c…
Towards Domain Generalization in Object Detection
Xingxuan Zhang, Zekai Xu, Renzhe Xu +5
Despite the striking performance achieved by modern detectors when training and test data are sampled from the same or similar distribution, the generalization ability of detectors…
ZIN: When and How to Learn Invariance Without Environment Partition?
Yong Lin, Shengyu Zhu, Lu Tan +1
It is commonplace to encounter heterogeneous data, of which some aspects of the data distribution may vary but the underlying causal mechanisms remain constant. When data are divid…
CausPref: Causal Preference Learning for Out-of-Distribution Recommendation
Yue He, Zimu Wang, Peng Cui +4
In spite of the tremendous development of recommender system owing to the progressive capability of machine learning recently, the current recommender system is still vulnerable to…
Causal Disentanglement for Semantics-Aware Intent Learning in Recommendation
Xiangmeng Wang, Qian Li, Dianer Yu +3
Traditional recommendation models trained on observational interaction data have generated large impacts in a wide range of applications, it faces bias problems that cover users' t…
A Theoretical Analysis on Independence-driven Importance Weighting for Covariate-shift Generalization
Renzhe Xu, Xingxuan Zhang, Zheyan Shen +2
Covariate-shift generalization, a typical case in out-of-distribution (OOD) generalization, requires a good performance on the unknown test distribution, which varies from the acce…
Towards Unsupervised Domain Generalization
Xingxuan Zhang, Linjun Zhou, Renzhe Xu +3
Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on…