607 citations · 2.1k across the 43 of their papers we have counts for
Showing 2022 · cs.LGShow all
2 papers · 2 filters
cs.LG2022★ 7 cited
Coder Reviewer Reranking for Code Generation
Tianyi Zhang, Tao Yu, Tatsunori B. Hashimoto +4
Sampling diverse programs from a code language model and reranking with model likelihood is a popular method for code generation but it is prone to preferring degenerate solutions.…
cs.LG2022★ 117 cited
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Tim Dettmers, Mike Lewis, Younes Belkada +1
Large language models have been widely adopted but require significant GPU memory for inference. We develop a procedure for Int8 matrix multiplication for feed-forward and attentio…