3 citations · 4 across the 7 of their papers we have counts for
4 papers · 1 filter
Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach
Yijia Zhang, Zhihong Gou, Shijie Cao +4
Deep Neural Networks (DNNs) have revolutionized various fields, but their deployment on GPUs often leads to significant energy consumption. Unlike existing methods for reducing GPU…
SoftmAP: Software-Hardware Co-design for Integer-Only Softmax on Associative Processors
Mariam Rakka, Jinhao Li, Guohao Dai +3
Recent research efforts focus on reducing the computational and memory overheads of Large Language Models (LLMs) to make them feasible on resource-constrained devices. Despite adva…
Large Language Model Inference Acceleration: A Comprehensive Hardware Perspective
Jinhao Li, Jiaming Xu, Shan Huang +9
Large Language Models (LLMs) have demonstrated remarkable capabilities across various fields, from natural language understanding to text generation. Compared to non-generative LLM…
MARCA: Mamba Accelerator with ReConfigurable Architecture
Jinhao Li, Shan Huang, Jiaming Xu +4
We propose a Mamba accelerator with reconfigurable architecture, MARCA.We propose three novel approaches in this paper. (1) Reduction alternative PE array architecture for both lin…