29 citations · 39 across the 6 of their papers we have counts for
7 papers
EnerInfer: Energy-Aware On-Device LLM Inference
Bohua Zou, Nian Liu, Binqi Sun +6
On-device LLM inference is increasingly attractive for privacy-preserving, reliable, and cost-effective deployment, yet its energy and thermal costs remain a critical bottleneck. E…
ProfInfer: An eBPF-based Fine-Grained LLM Inference Profiler
Bohua Zou, Debayan Roy, Dhimankumar Yogesh Airao +4
As large language models (LLMs) move from research to production, understanding how inference engines behave in real time has become both essential and elusive. Unlike general-purp…
Multi-Objective Memory Bandwidth Regulation and Cache Partitioning for Multicore Real-Time Systems
Binqi Sun, Zhihang Wei, Andrea Bastoni +5
Memory bandwidth regulation and cache partitioning are widely used techniques for achieving predictable timing in real-time computing systems. Combined with partitioned scheduling,…
PretVM: Predictable, Efficient Virtual Machine for Real-Time Concurrency
Shaokai Lin, Erling Jellum, Mirco Theile +10
This paper introduces the Precision-Timed Virtual Machine (PretVM), an intermediate platform facilitating the execution of quasi-static schedules compiled from a subset of programs…
Strict Partitioning for Sporadic Rigid Gang Tasks
Binqi Sun, Tomasz Kloda, Marco Caccamo
The rigid gang task model is based on the idea of executing multiple threads simultaneously on a fixed number of processors to increase efficiency and performance. Although there i…
Co-Optimizing Cache Partitioning and Multi-Core Task Scheduling: Exploit Cache Sensitivity or Not?
Binqi Sun, Debayan Roy, Tomasz Kloda +3
Cache partitioning techniques have been successfully adopted to mitigate interference among concurrently executing real-time tasks on multi-core processors. Considering that the ex…
Edge Generation Scheduling for DAG Tasks Using Deep Reinforcement Learning
Binqi Sun, Mirco Theile, Ziyuan Qin +4
Directed acyclic graph (DAG) tasks are currently adopted in the real-time domain to model complex applications from the automotive, avionics, and industrial domains that implement…