23 papers
HSMLA: Hierarchical Softmax Multi-scale Linear Attention for Efficient Vision Transformers
Dong Liu, Yanxuan Yu, Renata Borovica-Gajic +2
Vision transformers face significant computational overheads in high-resolution dense prediction due to the quadratic complexity of self-attention. Linear attention offers efficien…
RUBRIC: Realism--Utility Balanced Ranking for Imbalanced Classification
Yanxuan Yu, Dong Liu, Dong liu +11
Class imbalance poses a fundamental challenge in risk-sensitive applications such as fraud detection and medical diagnosis, where minority-class samples are scarce yet critical for…
SPI: Query-Depth-Adaptive Indexing for Streaming RAG in Vector Databases
Dong Liu, Yanxuan Yu
Vector databases (VecDBs) are increasingly deployed in retrieval-augmented generation (RAG) pipelines where query processing and document ingestion occur concurrently. The index la…
OLIVE: Online Low-Rank Incremental Learning for Efficient Adaptive Exoskeletons
Dong Liu, Yanxuan Yu, Ben Lengerich +3
Wearable exoskeleton systems hold promise for restoring mobility in individuals with physical impairments, yet most existing controllers rely on static gait policies that cannot ad…
PiKV: KV Cache Management System for Mixture of Experts
Dong Liu, Yanxuan Yu, Ben Lengerich +1
As large-scale language models continue to scale up in both size and context length, the memory and communication cost of key-value (KV) cache storage has become a major bottleneck…
AdaCorrection: Adaptive Offset Cache Correction for Accurate Diffusion Transformers
Dong Liu, Yanxuan Yu, Ben Lengerich +1
Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising…