Pushing the Envelope of LLM Inference on AI-PC and Intel GPUs

Evangelos Georganas, Dhiraj Kalamkar, Alexander Heinecke

The advent of ultra-low-bit LLM models (1/1.58/2-bit), which match the perplexity and end-task performance of their full-precision counterparts using the same model size, is usheri…