8 papers
Pricing Time, Not Just Tokens: Latency-Aware Mechanism Design for LLM Inference
Ian McDougall, Karthikeyan Sankaralingam
The economic theory of LLM pricing treats tokens as a homogeneous commodity considering aggregate token count as the main features buyers and sellers consider. We model inference a…
Beyond Static Policies: Dynamic Selection Among Modern Microarchitectural Policies
Yanxin Zhang, Ian McDougall, Junnan Li +3
Modern processors gain performance from interacting policies: prefetchers, predictors, replacement rules, and schedulers. These policies are often evaluated one at a time, yet a po…
Can LLMs Perform Technical Comprehension of Computer Architecture Papers?
Nishant Aggarwal, Aishwarya Lekshmi Chithra, Ayushi Dubal +8
Can large language models perform technical comprehension of computer architecture papers--not summarization, but structured critique that names the core mechanism, surfaces buried…
Beyond Static Policies: Exploring Dynamic Policy Selection for Single-Thread Performance Optimization
Yanxin Zhang, Ian McDougall, Junnan Li +3
For over a decade, processor design has focused on implementing sophisticated policies for various components of the out-of-order pipeline, including cache replacement and prefetch…
Agora: A System for Consumption-Based GPU Pricing
Ian McDougall, Noah Scott, Joon Huh +2
We present Agora, a lightweight system designed for cloud-based GPUs which meters a three-dimensional resource vector from commodity performance counters and prices it with a funct…
Penrose: Privacy-Preserving Performance Profiling of In-The-Wild GPUs
Ian McDougall, Michael Davies, Rahul Chatterjee +2
GPUs are the dominant platform for many important applications today including deep learning, accelerated computing, and scientific simulation. However, as the complexity of both a…
Pedagogically Motivated and Composable Open-Source RISC-V Processors for Computer Science Education
Ian McDougall, Harish Batchu, Michael Davies +1
While most instruction set architectures (ISAs) are only available to use through the purchase of a restrictive commercial license, the RISC-V ISA presents a free and open-source a…
IPU: Flexible Hardware Introspection Units
Ian McDougall, Shayne Wadle, Harish Batchu +1
Modern chip designs are increasingly complex, making it difficult for developers to glean meaningful insights about hardware behavior while real workloads are running. Hardware int…