4 papers
ECLIP: Energy-efficient and Practical Co-Location of ML Inference on Spatially Partitioned GPUs
Ryan Quach, Yidi Wang, Ali Jahanshahi +2
As AI inference becomes mainstream, research has begun to focus on improving the energy consumption of inference servers. Inference kernels commonly underutilize a GPU's compute re…
GCAPS: GPU Context-Aware Preemptive Priority-based Scheduling for Real-Time Tasks
Yidi Wang, Cong Liu, Daniel Wong +1
Scheduling real-time tasks that utilize GPUs with analyzable guarantees poses a significant challenge due to the intricate interaction between CPU and GPU resources, as well as the…
Unleashing the Power of Preemptive Priority-based Scheduling for Real-Time GPU Tasks
Yidi Wang, Cong Liu, Daniel Wong +1
Scheduling real-time tasks that utilize GPUs with analyzable guarantees poses a significant challenge due to the intricate interaction between CPU and GPU resources, as well as the…
CARTOS: A Charging-Aware Real-Time Operating System for Intermittent Batteryless Devices
Mohsen Karimi, Yidi Wang, Youngbin Kim +2
This paper presents CARTOS, a charging-aware real-time operating system designed to enhance the functionality of intermittently-powered batteryless devices (IPDs) for various Inter…