Is (Selective) Round-To-Nearest Quantization All You Need?

Alex Kogan

Quantization became a necessary tool for serving ever-increasing Large Language Models (LLMs). RTN (Round-to-Nearest) is perhaps the simplest quantization technique that has been a…