4 papers · 1 filter
ZETA: Leveraging Z-order Curves for Efficient Top-k Attention
Qiuhao Zeng, Jerry Huang, Peng Lu +4
Over recent years, the Transformer has become a fundamental building block for sequence modeling architectures. Yet at its core is the use of self-attention, whose memory and compu…
On the Benefits of Attribute-Driven Graph Domain Adaptation
Ruiyi Fang, Bingheng Li, Zhao Kang +5
Graph Domain Adaptation (GDA) addresses a pressing challenge in cross-network learning, particularly pertinent due to the absence of labeled data in real-world graph datasets. Rece…
Hessian Aware Low-Rank Perturbation for Order-Robust Continual Learning
Jiaqi Li, Yuanhao Lai, Rui Wang +7
Continual learning aims to learn a series of tasks sequentially without forgetting the knowledge acquired from the previous ones. In this work, we propose the Hessian Aware Low-Ran…
Intersectional Unfairness Discovery
Gezheng Xu, Qi Chen, Charles Ling +2
AI systems have been shown to produce unfair results for certain subgroups of population, highlighting the need to understand bias on certain sensitive attributes. Current research…