21 citations · 46 across the 13 of their papers we have counts for
13 papers
ARM: Attention with Routed-Memory for Learnable Sparse Control
Qiuhao Zeng, Jerry Huang, Peng Lu +7
Despite advances in long-context inference, large language models (LLMs) remain fundamentally limited by the key-value (KV) caching mechanisms that are necessary for stable computa…
Full spectrum Unlearnable Examples via Spectral Equalization
Jiale Cai, Gezheng Xu, Zhihao Li +6
Unlearnable examples (UEs) protect training data by injecting imperceptible perturbations so that models fail to extract exploitable representations. In this paper, we reveal that…
Baguan-TS: A Sequence-Native In-Context Learning Model for Time Series Forecasting with Covariates
Linxiao Yang, Xue Jiang, Gezheng Xu +9
Transformers enable in-context learning (ICL) for rapid, gradient-free adaptation in time series forecasting, yet most ICL-style approaches rely on tabularized, hand-crafted featur…
When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining
Zhihao Li, Gezheng Xu, Jiale Cai +5
Unlearnable Examples (UEs) serve as a data protection strategy that generates imperceptible perturbations to mislead models into learning spurious correlations instead of underlyin…
Homophily Enhanced Graph Domain Adaptation
Ruiyi Fang, Bingheng Li, Jingyu Zhao +5
Graph Domain Adaptation (GDA) transfers knowledge from labeled source graphs to unlabeled target graphs, addressing the challenge of label scarcity. In this paper, we highlight the…
ZETA: Leveraging Z-order Curves for Efficient Top-k Attention
Qiuhao Zeng, Jerry Huang, Peng Lu +4
Over recent years, the Transformer has become a fundamental building block for sequence modeling architectures. Yet at its core is the use of self-attention, whose memory and compu…
Leveraging Group Classification with Descending Soft Labeling for Deep Imbalanced Regression
Ruizhi Pu, Gezheng Xu, Ruiyi Fang +3
Deep imbalanced regression (DIR), where the target values have a highly skewed distribution and are also continuous, is an intriguing yet under-explored problem in machine learning…
Intersectional Unfairness Discovery
Gezheng Xu, Qi Chen, Charles Ling +2
AI systems have been shown to produce unfair results for certain subgroups of population, highlighting the need to understand bias on certain sensitive attributes. Current research…
Generalizing across Temporal Domains with Koopman Operators
Qiuhao Zeng, Wei Wang, Fan Zhou +7
In the field of domain generalization, the task of constructing a predictive model capable of generalizing to a target domain without access to target data remains challenging. Thi…
When Source-Free Domain Adaptation Meets Learning with Noisy Labels
Li Yi, Gezheng Xu, Pengcheng Xu +5
Recent state-of-the-art source-free domain adaptation (SFDA) methods have focused on learning meaningful cluster structures in the feature space, which have succeeded in adapting t…
On Learning Fairness and Accuracy on Multiple Subgroups
Changjian Shui, Gezheng Xu, Qi Chen +5
We propose an analysis in fair learning that preserves the utility of the data while reducing prediction disparities under the criteria of group sufficiency. We focus on the scenar…
Evolving Domain Generalization
William Wei Wang, Gezheng Xu, Ruizhi Pu +6
Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any…
Gap Minimization for Knowledge Sharing and Transfer
Boyu Wang, Jorge Mendez, Changjian Shui +5
Learning from multiple related tasks by knowledge sharing and transfer has become increasingly relevant over the last two decades. In order to successfully transfer information fro…