4 papers
RED-PIM: Reducing Data Movement for Transformers using Processing-in-Memory
Zahra Yousefijamarani, Alaa Alameldeen
Transformers are widely used across many domains, including natural language processing, computer vision, web search, and DNA sequence analysis. Given their broad applicability, im…
MEPIC: Memory Efficient Position Independent Caching for LLM Serving
Qian Wang, Zahra Yousefijamarani, Morgan Lindsay Heisler +8
Modern LLM applications such as deep-research assistants, coding agents, and Retrieval-Augmented Generation (RAG) systems, repeatedly process long prompt histories containing share…
DL-PIM: Improving Data Locality in Processing-in-Memory Systems
Parker Hao Tian, Zahra Yousefijamarani, Alaa Alameldeen
PIM architectures aim to reduce data transfer costs between processors and memory by integrating processing units within memory layers. Prior PIM architectures have shown potential…
HFX: Joint Design of Algorithms and Systems for Multi-SLO Serving and Fast Scaling
Zahra Yousefijamarani, Xinglu Wang, Qian Wang +12
Large language model (LLM) serving faces the dual challenge of meeting strict user-specific service-level objectives (SLOs) while minimizing computational cost under dynamic, multi…