3 papers
cs.LG2025
HashEvict: A Pre-Attention KV Cache Eviction Strategy using Locality-Sensitive Hashing
Minghui Liu, Tahseen Rabbani, Tony O'Halloran +5
Transformer-based large language models (LLMs) use the key-value (KV) cache to significantly accelerate inference by storing the key and value embeddings of past tokens. However, t…
cs.DC2025
Accelerating Sparse Tensor Decomposition Using Adaptive Linearized Representation
Jan Laukemann, Ahmed E. Helal, S. Isaac Geronimo Anderson +7
High-dimensional sparse data emerge in many critical application domains such as healthcare and cybersecurity. To extract meaningful insights from massive volumes of these multi-di…
cs.LG2024
Calibrated Dataset Condensation for Faster Hyperparameter Search
Mucong Ding, Yuancheng Xu, Tahseen Rabbani +5
Dataset condensation can be used to reduce the computational cost of training multiple models on a large dataset by condensing the training dataset into a small synthetic set. Stat…