Counting papers with at most 25 authors, so collaboration author lists do not stand in for the people here.
1 paper
Fanzhe Wei, Li Liu, Ziyang Wang +1
KV-cache quantization is validated today by offline benchmark averages; a deployed system cannot tell whether compression is damaging the request it is serving right now. We give i…