Huff-LLM: End-to-End Lossless Compression for Efficient LLM Inference

Patrick Yubeaton, Tareq Mahmoud, Shehab Naga +8

As they become more capable, large language models (LLMs) have continued to rapidly increase in size. This has exacerbated the difficulty in running state of the art LLMs on small,…