1 paper · 1 filter
Mohammad Wathiq Soualhi
While 4-bit weight quantization is critical for deploying Small Language Models (SLMs) on edge devices, evaluations of the resulting performance degradation-the quantization tax-re…