2 papers
cs.LG2026
Accelerating GPU Inference of Large Language Models with Moderately Unstructured Sparse Weight Matrices
Tao Lu, Haoyu Wang, Zonghui Wang +3
With the growing deployment of large language models (LLMs), LLM inference cost has become a key challenge. Pruning techniques that introduce sparsity into weight matrices can acce…
cs.AR2023
PyHGL: A Python-based Hardware Generation Language Framework
Jintao Sun, Zeke Wang, Tao Lu +1
Hardware generation languages (HGLs) increase hardware design productivity by creating parameterized modules and test benches. Unfortunately, existing tools are not widely adopted…