most citedQUIK: Towards End-to-End 4-Bit Inference on Generative Large Language Models

2 citations · 2 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2023★ 2 cited

QUIK: Towards End-to-End 4-Bit Inference on Generative Large Language Models

Saleh Ashkboos, Ilia Markov, Elias Frantar +5

Large Language Models (LLMs) from the GPT family have become extremely popular, leading to a race towards reducing their inference costs to allow for efficient local computation. Y…