4 citations · 4 across the 5 of their papers we have counts for
5 papers
HD-MoE: Hybrid and Dynamic Parallelism for Mixture-of-Expert LLMs with 3D Near-Memory Processing
Haochen Huang, Shuzhang Zhong, Zhe Zhang +5
Large Language Models (LLMs) with Mixture-of-Expert (MoE) architectures achieve superior model performance with reduced computation costs, but at the cost of high memory capacity a…
Predicting the Output Structure of Sparse Matrix Multiplication with Sampled Compression Ratio
Zhaoyang Du, Yijin Guan, Tianchan Guan +7
Sparse general matrix multiplication (SpGEMM) is a fundamental building block in numerous scientific applications. One critical task of SpGEMM is to compute or predict the structur…
OpSparse: a Highly Optimized Framework for Sparse General Matrix Multiplication on GPUs
Zhaoyang Du, Yijin Guan, Tianchan Guan +4
Sparse general matrix multiplication (SpGEMM) is an important and expensive computation primitive in many real-world applications. Due to SpGEMM's inherent irregularity and the vas…
Accelerating CPU-Based Sparse General Matrix Multiplication With Binary Row Merging
Zhaoyang Du, Yijin Guan, Tianchan Guan +3
Sparse general matrix multiplication (SpGEMM) is a fundamental building block for many real-world applications. Since SpGEMM is a well-known memory-bounded application with vast an…
MPU: Towards Bandwidth-abundant SIMT Processor via Near-bank Computing
Xinfeng Xie, Peng Gu, Yufei Ding +3
With the growing number of data-intensive workloads, GPU, which is the state-of-the-art single-instruction-multiple-thread (SIMT) processor, is hindered by the memory bandwidth wal…