21 citations · 46 across the 13 of their papers we have counts for
10 papers · 1 filter
ARM: Attention with Routed-Memory for Learnable Sparse Control
Qiuhao Zeng, Jerry Huang, Peng Lu +7
Despite advances in long-context inference, large language models (LLMs) remain fundamentally limited by the key-value (KV) caching mechanisms that are necessary for stable computa…
Baguan-TS: A Sequence-Native In-Context Learning Model for Time Series Forecasting with Covariates
Linxiao Yang, Xue Jiang, Gezheng Xu +9
Transformers enable in-context learning (ICL) for rapid, gradient-free adaptation in time series forecasting, yet most ICL-style approaches rely on tabularized, hand-crafted featur…
When Priors Backfire: On the Vulnerability of Unlearnable Examples to Pretraining
Zhihao Li, Gezheng Xu, Jiale Cai +5
Unlearnable Examples (UEs) serve as a data protection strategy that generates imperceptible perturbations to mislead models into learning spurious correlations instead of underlyin…
ZETA: Leveraging Z-order Curves for Efficient Top-k Attention
Qiuhao Zeng, Jerry Huang, Peng Lu +4
Over recent years, the Transformer has become a fundamental building block for sequence modeling architectures. Yet at its core is the use of self-attention, whose memory and compu…
Leveraging Group Classification with Descending Soft Labeling for Deep Imbalanced Regression
Ruizhi Pu, Gezheng Xu, Ruiyi Fang +3
Deep imbalanced regression (DIR), where the target values have a highly skewed distribution and are also continuous, is an intriguing yet under-explored problem in machine learning…
Intersectional Unfairness Discovery
Gezheng Xu, Qi Chen, Charles Ling +2
AI systems have been shown to produce unfair results for certain subgroups of population, highlighting the need to understand bias on certain sensitive attributes. Current research…
Generalizing across Temporal Domains with Koopman Operators
Qiuhao Zeng, Wei Wang, Fan Zhou +7
In the field of domain generalization, the task of constructing a predictive model capable of generalizing to a target domain without access to target data remains challenging. Thi…
When Source-Free Domain Adaptation Meets Learning with Noisy Labels
Li Yi, Gezheng Xu, Pengcheng Xu +5
Recent state-of-the-art source-free domain adaptation (SFDA) methods have focused on learning meaningful cluster structures in the feature space, which have succeeded in adapting t…
Evolving Domain Generalization
William Wei Wang, Gezheng Xu, Ruizhi Pu +6
Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any…
Gap Minimization for Knowledge Sharing and Transfer
Boyu Wang, Jorge Mendez, Changjian Shui +5
Learning from multiple related tasks by knowledge sharing and transfer has become increasingly relevant over the last two decades. In order to successfully transfer information fro…