78 citations · 117 across the 7 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
SmoothRot: Combining Channel-Wise Scaling and Rotation for Quantization-Friendly LLMs
Patrik Czakó, Gábor Kertész, Sándor Szénási
We present SmoothRot, a novel post-training quantization technique to enhance the efficiency of 4-bit quantization in Large Language Models (LLMs). SmoothRot addresses the critical…
cs.CL2024★ 38 cited
Achieving Peak Performance for Large Language Models: A Systematic Review
Zhyar Rzgar K Rostam, Sándor Szénási, Gábor Kertész
In recent years, large language models (LLMs) have achieved remarkable success in natural language processing (NLP). LLMs require an extreme amount of parameters to attain high per…