works on
consumer devices 1cpu-gpu offloading 1inference optimization 1large language models 1tensor scheduling 1

From the 1 of 3 linked papers with an AI index.

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2025

LCQ: Low-Rank Codebook based Quantization for Large Language Models

Wen-Pu Cai, Ming-Yang Li, Wu-Jun Li

Large language models~(LLMs) have recently demonstrated promising performance in many tasks. However, the high storage and computational cost of LLMs has become a challenge for dep…