147 citations · 500 across the 37 of their papers we have counts for
1 paper · 1 filter
Mukund Athmaram, Manoj Rao, Liang Ma
Choosing a mixed-precision configuration for large language model (LLM) serving trades speed against accuracy. Allocators that use average bit-width or a memory budget as a speed p…