works on
cxl 1gpu 1heterogeneous computing 1large language model serving 1mixed-length workloads 1processing-near-memory 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.AR2026

NELSSA: A GPU-PNM Heterogeneous System for Mixed-Length LLM Serving via Length-based Request Placement

Sookyung Choi, Seungyong Lee, Kangkyu Park +11

The paper introduces NELSSA, a system that combines GPUs with processing‑near‑memory (PNM) accelerators to efficiently serve large language model requests of varying context length…