cxl 1gpu 1heterogeneous computing 1large language model serving 1mixed-length workloads 1processing-near-memory 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.AR2026
NELSSA: A GPU-PNM Heterogeneous System for Mixed-Length LLM Serving via Length-based Request Placement
Sookyung Choi, Seungyong Lee, Kangkyu Park +11
The paper introduces NELSSA, a system that combines GPUs with processing‑near‑memory (PNM) accelerators to efficiently serve large language model requests of varying context length…
cs.DC2026
AXLE: Coordinated Offloading with Asynchronous Back-Streaming in Computational Memory Systems
Suyeon Lee, Kangkyu Park, Kwangsik Shin +1
CXL-based Computational Memory (CCM) enables near-memory processing within expanded remote memory, offering opportunities to address data movement costs in disaggregated memory sys…