4 papers · 1 filter
Unifying Uniform and Binary-coding Quantization for Accurate Compression of Large Language Models
Seungcheol Park, Jeongin Bae, Beomseok Kwon +5
How can we quantize large language models while preserving accuracy? Quantization is essential for deploying large language models (LLMs) efficiently. Binary-coding quantization (B…
Accurate Sublayer Pruning for Large Language Models by Exploiting Latency and Tunability Information
Seungcheol Park, Sojin Lee, Jongjin Kim +3
How can we accelerate large language models(LLMs) without sacrificing accuracy? The slow inference speed of LLMs hinders us to benefit from their remarkable performance in diverse…
Susceptibility of Large Language Models to User-Driven Factors in Medical Queries
Kyung Ho Lim, Ujin Kang, Xiang Li +4
Large language models (LLMs) are increasingly used in healthcare, but their reliability is heavily influenced by user-driven factors such as question phrasing and the completeness…
A Comprehensive Survey of Compression Algorithms for Language Models
Seungcheol Park, Jaehyeon Choi, Sojin Lee +1
How can we compress language models without sacrificing accuracy? The number of compression algorithms for language models is rapidly growing to benefit from remarkable advances of…