2 citations · 3 across the 7 of their papers we have counts for
7 papers
XKV: Personalized KV Cache Memory Reduction for Long-Context LLM Inference
Weizhuo Li, Zhigang Wang, Yu Gu +1
Recently the generative Large Language Model (LLM) has achieved remarkable success in numerous applications. Notably its inference generates output tokens one-by-one, leading to ma…
Hierarchical Gradient-Based Genetic Sampling for Accurate Prediction of Biological Oscillations
Heng Rao, Yu Gu, Jason Zipeng Zhang +3
Biological oscillations are periodic changes in various signaling processes crucial for the proper functioning of living organisms. These oscillations are modeled by ordinary diffe…
LR-CNN: Lightweight Row-centric Convolutional Neural Network Training for Memory Reduction
Zhigang Wang, Hangyu Yang, Ning Wang +5
In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of…
Accelerating Heterogeneous Tensor Parallelism via Flexible Workload Control
Zhigang Wang, Xu Zhang, Ning Wang +5
Transformer-based models are becoming deeper and larger recently. For better scalability, an underlying training solution in industry is to split billions of parameters (tensors) i…
Text Matching Improves Sequential Recommendation by Reducing Popularity Biases
Zhenghao Liu, Sen Mei, Chenyan Xiong +5
This paper proposes Text mAtching based SequenTial rEcommendation model (TASTE), which maps items and users in an embedding space and recommends items by matching their text repres…
Structure-Aware Language Model Pretraining Improves Dense Retrieval on Structured Data
Xinze Li, Zhenghao Liu, Chenyan Xiong +4
This paper presents Structure Aware Dense Retrieval (SANTA) model, which encodes user queries and structured data in one universal embedding space for retrieving structured data. S…
CHGNN: A Semi-Supervised Contrastive Hypergraph Learning Network
Yumeng Song, Yu Gu, Tianyi Li +4
Hypergraphs can model higher-order relationships among data objects that are found in applications such as social networks and bioinformatics. However, recent studies on hypergraph…