2 papers
cs.CL2025
SplitReason: Learning To Offload Reasoning
Yash Akhauri, Anthony Fei, Chi-Chih Chang +3
Reasoning in large language models (LLMs) tends to produce substantially longer token generation sequences than simpler language modeling tasks. This extended generation length ref…
cs.CL2024
NITRO: LLM Inference on Intel Laptop NPUs
Anthony Fei, Mohamed S. Abdelfattah
Large Language Models (LLMs) have become essential tools in natural language processing, finding large usage in chatbots such as ChatGPT and Gemini, and are a central area of resea…