5 papers
EPAS: Efficient Training with Progressive Activation Sharing
Rezaul Karim, Maryam Dialameh, Yang Liu +2
We present a novel method for Efficient training with Progressive Activation Sharing (EPAS). This method bridges progressive training paradigm with the phenomenon of redundant QK (…
A MINRES-based Linesearch Algorithm for Nonconvex Optimization with Non-positive Curvature Detection
Hanfeng Zeng, Yang Liu, Wenqing Ouyang +1
We propose a MINRES-based Newton-type algorithm for solving unconstrained nonconvex optimization problems. Our approach uses the minimal residual method (MINRES), a well-known solv…
MMOC: Self-Supervised EEG Emotion Recognition Framework with Multi-Model Online Collaboration
Hanqi Wang, Yang Liu, Peng Ye +1
Electroencephalography (EEG) emotion recognition plays a crucial role in human-computer interaction, particularly in healthcare and neuroscience. While supervised learning has been…
Exploring the Tradeoff Between Diversity and Discrimination for Continuous Category Discovery
Ruobing Jiang, Yang Liu, Haobing Liu +2
Continuous category discovery (CCD) aims to automatically discover novel categories in continuously arriving unlabeled data. This is a challenging problem considering that there is…
Leveraging Registers in Vision Transformers for Robust Adaptation
Srikar Yellapragada, Kowshik Thopalli, Vivek Narayanaswamy +5
Vision Transformers (ViTs) have shown success across a variety of tasks due to their ability to capture global image representations. Recent studies have identified the existence o…