111 citations · 184 across the 9 of their papers we have counts for
4 papers · 1 filter
Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression
Kabir Swain, Sijie Han, Daniel Karl I. Weidele +3
We propose \textbf{Hurwitz Quaternion Multiplicative Quantization (HQMQ)}, a \textbf{calibration-free} method for KV cache compression of large language models. HQMQ treats each 4-…
Tensor Cache: Eviction-conditioned Associative Memory for Transformers
Kabir Swain, Sijie Han, Daniel Karl I. Weidele +2
Autoregressive Transformer KV caches grow linearly with context length; sliding-window caching bounds memory but discards evicted tokens entirely, so relevant evidence outside the…
Small Models, Smarter Learning: The Power of Joint Task Training
Csaba Both, Benjamin Hoover, Hendrik Strobelt +4
Multi-task learning improves generalization, but when does it reduce the model capacity required to learn? We provide a systematic study of how joint training affects the learning…
AutoAIViz: Opening the Blackbox of Automated Artificial Intelligence with Conditional Parallel Coordinates
Daniel Karl I. Weidele, Justin D. Weisz, Eno Oduor +4
Artificial Intelligence (AI) can now automate the algorithm selection, feature engineering, and hyperparameter tuning steps in a machine learning workflow. Commonly known as AutoML…