47 citations · 106 across the 22 of their papers we have counts for
1 paper · 1 filter
Mukund Athmaram, Manoj Rao, Liang Ma
Choosing a mixed-precision configuration for large language model (LLM) serving trades speed against accuracy. Allocators that use average bit-width or a memory budget as a speed p…