3 citations · 3 across the 3 of their papers we have counts for
3 papers
KVCrush: Key value cache size-reduction using similarity in head-behaviour
Gopi Krishna Jha, Sameh Gobriel, Liubov Talamanova +1
Key-value (KV) caching has emerged as a crucial optimization technique for accelerating inference in large language models (LLMs). By allowing the attention operation to scale line…
ARGO: An Auto-Tuning Runtime System for Scalable GNN Training on Multi-Core Processor
Yi-Chien Lin, Yuyang Chen, Sameh Gobriel +3
As Graph Neural Networks (GNNs) become popular, libraries like PyTorch-Geometric (PyG) and Deep Graph Library (DGL) are proposed; these libraries have emerged as the de facto stand…
Streaming Encoding Algorithms for Scalable Hyperdimensional Computing
Anthony Thomas, Behnam Khaleghi, Gopi Krishna Jha +5
Hyperdimensional computing (HDC) is a paradigm for data representation and learning originating in computational neuroscience. HDC represents data as high-dimensional, low-precisio…