3 citations · 3 across the 6 of their papers we have counts for
8 papers
A Shape-Adaptive Architecture with Disaggregated Quantization for Efficient LLM Serving
Cong Guo, Chiyue Wei, Bowen Duan +5
Large language models (LLMs) have become the backbone of modern AI applications, but pose significant challenges for efficient inference. Their autoregressive generation divides ex…
Vortex: Bridging Extreme Compression and Efficient LLM Inference
Haoxuan Shan, Cong Guo, Bowen Duan +6
Extreme compression techniques, including vector quantization (VQ) and input-dependent sparsity, can significantly reduce the memory footprint of large language models (LLMs). Howe…
Optimus: Elastic Decoding for Efficient Diffusion LLM Serving
Chiyue Wei, Cong Guo, Bowen Duan +7
Large language model (LLM) serving is fundamentally limited by inefficient hardware utilization. Autoregressive (AR) decoding underutilizes GPUs due to its strictly sequential exec…
EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture
Bowen Duan, Cong Guo, Chiyue Wei +8
Large Language Models (LLMs) have achieved impressive performance across diverse domains but remain inefficient during the autoregressive decoding phase. Unlike the prefill stage,…
Focus: A Streaming Concentration Architecture for Efficient Vision-Language Models
Chiyue Wei, Cong Guo, Junyao Zhang +8
Vision-Language Models (VLMs) have demonstrated strong performance on tasks such as video captioning and visual question answering. However, their growing scale and video-level inp…
Platinum: Path-Adaptable LUT-Based Accelerator Tailored for Low-Bit Weight Matrix Multiplication
Haoxuan Shan, Cong Guo, Chiyue Wei +4
The rapid scaling of large language models demands more efficient hardware. Quantization offers a promising trade-off between efficiency and performance. With ultra-low-bit quantiz…
A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models
Cong Guo, Feng Cheng, Zhixu Du +21
The rapid development of large language models (LLMs) has significantly transformed the field of artificial intelligence, demonstrating remarkable capabilities in natural language…
ModSRAM: Algorithm-Hardware Co-Design for Large Number Modular Multiplication in SRAM
Jonathan Ku, Junyao Zhang, Haoxuan Shan +6
Elliptic curve cryptography (ECC) is widely used in security applications such as public key cryptography (PKC) and zero-knowledge proofs (ZKP). ECC is composed of modular arithmet…