2 papers
cs.LG2026
SelectInfer: Selective Neuron Loading and Computation for On-Device LLMs
Huzaifa Shaaban Kabakibo, Eric Schniedermeyer, Artem Burchanow +1
Large Language Models (LLMs) have demonstrated remarkable capabilities across a range of Natural Language Processing (NLP) tasks, but their high computational and memory demands po…
cs.LG2026
NKI-Agent: Domain-Specific Fine-Tuning and Agentic Tool Use for Neuron Kernel Generation
Junjie Tang, Jun Huan, Hao Zhou +2
Recent agentic approaches to LLM-based kernel generation have achieved impressive results on CUDA. For emerging AI accelerators such as AWS Trainium and Inferentia, automated kerne…