15 papers
HSMLA: Hierarchical Softmax Multi-scale Linear Attention for Efficient Vision Transformers
Dong Liu, Yanxuan Yu, Renata Borovica-Gajic +2
Vision transformers face significant computational overheads in high-resolution dense prediction due to the quadratic complexity of self-attention. Linear attention offers efficien…
Context-Adaptive Inference: A Unified Statistical and Foundation-Model View
Yue Yao, Caleb N. Ellington, Jingyun Jia +9
Modern predictive systems are expected to adapt their behavior to the specific situation they are facing. A clinical model should not treat every patient the same; a retrieval-augm…
RUBRIC: Realism--Utility Balanced Ranking for Imbalanced Classification
Yanxuan Yu, Dong Liu, Dong liu +11
Class imbalance poses a fundamental challenge in risk-sensitive applications such as fraud detection and medical diagnosis, where minority-class samples are scarce yet critical for…
SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases
Dong Liu, Yanxuan Yu
Vector databases (VecDBs) are increasingly deployed in retrieval-augmented generation (RAG) pipelines where query processing and document ingestion occur concurrently. The index la…
OLIVE: Online Low-Rank Incremental Learning for Efficient Adaptive Exoskeletons
Dong Liu, Yanxuan Yu, Ben Lengerich +3
Wearable exoskeleton systems hold promise for restoring mobility in individuals with physical impairments, yet most existing controllers rely on static gait policies that cannot ad…
AdaCorrection: Adaptive Offset Cache Correction for Accurate Diffusion Transformers
Dong Liu, Yanxuan Yu, Ben Lengerich +1
Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising…