TimeBill: Time-Budgeted Inference for Large Language Models

Qi Fan, An Zou, Yehan Ma

Large Language Models (LLMs) are increasingly deployed in time-critical systems, such as robotics, autonomous driving, embodied intelligence, and industrial automation, where gener…