4 papers
DWDP: Distributed Weight Data Parallelism for High-Performance LLM Inference on NVL72
Wanqian Li, Jintao Peng, Zongfei Jing +7
Large language model (LLM) inference increasingly depends on multi-GPU execution, yet existing inference parallelization strategies require layer-wise inter-rank synchronization, m…
PIMCOMP: An End-to-End DNN Compiler for Processing-In-Memory Accelerators
Xiaotian Sun, Xinyu Wang, Wanqian Li +2
Various processing-in-memory (PIM) accelerators based on various devices, micro-architectures, and interfaces have been proposed to accelerate deep neural networks (DNNs). How to d…
PIMSYN: Synthesizing Processing-in-memory CNN Accelerators
Wanqian Li, Xiaotian Sun, Xinyu Wang +3
Processing-in-memory architectures have been regarded as a promising solution for CNN acceleration. Existing PIM accelerator designs rely heavily on the experience of experts and r…
PIMCOMP: A Universal Compilation Framework for Crossbar-based PIM DNN Accelerators
Xiaotian Sun, Xinyu Wang, Wanqian Li +3
Crossbar-based PIM DNN accelerators can provide massively parallel in-situ operations. A specifically designed compiler is important to achieve high performance for a wide variety…