From the 1 of 5 linked papers with an AI index.
5 papers
FOLIO: Focused Semantic Memory for Streaming Video Understanding
Haoyang Fan, Dhruv Parikh, Anvitha Ramachandran +4
The paper introduces FOLIO, a training‑free focused semantic memory system that records detailed information about important entities in a streaming video while compactly storing s…
LLM-Guided ANN Index Optimization for Human-Object Interaction Retrieval
Shahrzad Esmat, Chaunte W. Lacewell, Sameh Gobriel +2
Retrieval systems underpin modern AI applications -- spanning visual search, recommendation engines, and multi-modal question answering. Modern multi-stage retrieval systems requir…
KVCrush: Key value cache size-reduction using similarity in head-behaviour
Gopi Krishna Jha, Sameh Gobriel, Liubov Talamanova +1
Key-value (KV) caching has emerged as a crucial optimization technique for accelerating inference in large language models (LLMs). By allowing the attention operation to scale line…
Mem-Rec: Memory Efficient Recommendation System using Alternative Representation
Gopi Krishna Jha, Anthony Thomas, Nilesh Jain +3
Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendatio…
SparAMX: Accelerating Compressed LLMs Token Generation on AMX-powered CPUs
Ahmed F. AbouElhamayed, Jordan Dotzel, Yash Akhauri +6
Large language models have high compute, latency, and memory requirements. While specialized accelerators such as GPUs and TPUs typically run these workloads, CPUs are more widely…