English K_Quantization of LLMs Does Not Disproportionately Diminish Multilingual Performance

Karl Audun Borgersen, Morten Goodwin

For consumer usage of locally deployed LLMs, the GGUF format and k\_quantization are invaluable tools for maintaining the performance of the original model while reducing it to siz…