44 citations · 130 across the 14 of their papers we have counts for
14 papers
LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
Hongye Jin, Xiaotian Han, Jingfeng Yang +5
It is well known that LLMs cannot generalize well to long contexts whose lengths are larger than the training sequence length. This poses challenges when employing LLMs for process…
Towards Mitigating Dimensional Collapse of Representations in Collaborative Filtering
Huiyuan Chen, Vivian Lai, Hongye Jin +3
Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Informa…
Chasing Fairness in Graphs: A GNN Architecture Perspective
Zhimeng Jiang, Xiaotian Han, Chao Fan +4
There has been significant progress in improving the performance of graph neural networks (GNNs) through enhancements in graph data, model architecture design, and training strateg…
GrowLength: Accelerating LLMs Pretraining by Progressively Growing Training Length
Hongye Jin, Xiaotian Han, Jingfeng Yang +3
The evolving sophistication and intricacies of Large Language Models (LLMs) yield unprecedented advancements, yet they simultaneously demand considerable computational resources an…
On the Equivalence of Graph Convolution and Mixup
Xiaotian Han, Hanqing Zeng, Yu Chen +9
This paper investigates the relationship between graph convolution and Mixup techniques. Graph convolution in a graph neural network involves aggregating features from neighboring…
FFB: A Fair Fairness Benchmark for In-Processing Group Fairness Methods
Xiaotian Han, Jianfeng Chi, Yu Chen +4
This paper introduces the Fair Fairness Benchmark (\textsf{FFB}), a benchmarking framework for in-processing group fairness methods. Ensuring fairness in machine learning is import…
Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approach
Zhimeng Jiang, Xiaotian Han, Hongye Jin +4
Fairness in machine learning has attracted increasing attention in recent years. The fairness methods improving algorithmic fairness for in-distribution data may not perform well u…
Retiring DP: New Distribution-Level Metrics for Demographic Parity
Xiaotian Han, Zhimeng Jiang, Hongye Jin +4
Demographic parity is the most widely recognized measure of group fairness in machine learning, which ensures equal treatment of different demographic groups. Numerous works aim to…
MLPInit: Embarrassingly Simple GNN Training Acceleration with MLP Initialization
Xiaotian Han, Tong Zhao, Yozen Liu +2
Training graph neural networks (GNNs) on large graphs is complex and extremely time consuming. This is attributed to overheads caused by sparse matrix multiplication, which are sid…
DIVISION: Memory Efficient Training via Dual Activation Precision
Guanchu Wang, Zirui Liu, Zhimeng Jiang +3
Activation compressed training provides a solution towards reducing the memory cost of training deep neural networks~(DNNs). However, state-of-the-art work combines a search of qua…
Auto-PINN: Understanding and Optimizing Physics-Informed Neural Architecture
Yicheng Wang, Xiaotian Han, Chia-Yuan Chang +3
Physics-informed neural networks (PINNs) are revolutionizing science and engineering practice by bringing together the power of deep learning to bear on scientific computation. In…
G-Mixup: Graph Data Augmentation for Graph Classification
Xiaotian Han, Zhimeng Jiang, Ninghao Liu +1
This work develops \emph{mixup for graph data}. Mixup has shown superiority in improving the generalization and robustness of neural networks by interpolating features and labels b…
Geometric Graph Representation Learning via Maximizing Rate Reduction
Xiaotian Han, Zhimeng Jiang, Ninghao Liu +3
Learning discriminative node representations benefits various downstream tasks in graph analysis such as community detection and node classification. Existing graph representation…
FMP: Toward Fair Graph Message Passing against Topology Bias
Zhimeng Jiang, Xiaotian Han, Chao Fan +4
Despite recent advances in achieving fair representations and predictions through regularization, adversarial debiasing, and contrastive learning in graph neural networks (GNNs), t…