activity
20242026
most citedLUT-LLM: Efficient Large Language Model Inference with Memory-based Computations on FPGAs

1 citations · 1 across the 5 of their papers we have counts for

collaborators
Showing 2024Show all

2 papers · 1 filter

cs.LG2024

BitMoD: Bit-serial Mixture-of-Datatype LLM Acceleration

Yuzong Chen, Ahmed F. AbouElhamayed, Xilai Dai +4

Large language models (LLMs) have demonstrated remarkable performance across various machine learning tasks. Yet the substantial memory footprint of LLMs significantly hinders thei…

cs.AI2024

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models

Yifei Liu, Jicheng Wen, Yang Wang +5

Scaling model size significantly challenges the deployment and inference of Large Language Models (LLMs). Due to the redundancy in LLM weights, recent research has focused on pushi…