activity
20232026
most citedQUIK: Towards End-to-End 4-Bit Inference on Generative Large Language Models

2 citations · 2 across the 10 of their papers we have counts for

collaborators
Showing 2023Show all

2 papers · 1 filter

cs.LG2023★ 2 cited

QUIK: Towards End-to-End 4-Bit Inference on Generative Large Language Models

Saleh Ashkboos, Ilia Markov, Elias Frantar +5

Large Language Models (LLMs) from the GPT family have become extremely popular, leading to a race towards reducing their inference costs to allow for efficient local computation. Y…

cs.CL2023

Reasoning about Ambiguous Definite Descriptions

Stefan F. Schouten, Peter Bloem, Ilia Markov +1

Natural language reasoning plays an increasingly important role in improving language models' ability to solve complex language understanding tasks. An interesting use case for rea…