SelectInfer: Selective Neuron Loading and Computation for On-Device LLMs

Huzaifa Shaaban Kabakibo, Eric Schniedermeyer, Artem Burchanow +1

Large Language Models (LLMs) have demonstrated remarkable capabilities across a range of Natural Language Processing (NLP) tasks, but their high computational and memory demands po…