16 citations · 28 across the 6 of their papers we have counts for
6 papers
ViBE: Co-Optimizing Workload Skew and Hardware Variability for MoE Serving
Seokjin Go, Marko Scrbak, Ephrem Wu +2
In distributed Mixture-of-Experts (MoE) inference, input-dependent token routing interacts with GPU performance variability to create persistent stragglers under synchronized execu…
Power Aware Dynamic Reallocation For Inference
Yiwei Jiang, Sangeeta Chowdhary, Nathaniel Morris +3
Disaggregation has emerged as a powerful strategy for optimizing large language model (LLM) inference by separating compute-intensive prefill and memory-bound decode phases across…
Design Space Exploration and Optimization for Carbon-Efficient Extended Reality Systems
Mariam Elgamal, Doug Carmean, Elnaz Ansari +8
As computing hardware becomes more specialized, designing environmentally sustainable computing systems requires accounting for both hardware and software parameters. Our goal is t…
Socio-Technological Challenges and Opportunities: Paths Forward
Carole-Jean Wu, Srilatha Manne, Parthasarathy Ranganathan +2
Advancements in digital technologies have a bootstrapping effect. The past fifty years of technological innovations from the computer architecture community have brought innovation…
A Scalable Decoder Micro-architecture for Fault-Tolerant Quantum Computing
Poulami Das, Christopher A. Pattison, Srilatha Manne +4
Quantum computation promises significant computational advantages over classical computation for some problems. However, quantum hardware suffers from much higher error rates than…
Enabling Efficient Dynamic Resizing of Large DRAM Caches via A Hardware Consistent Hashing Mechanism
Kevin K. Chang, Gabriel H. Loh, Mithuna Thottethodi +6
Die-stacked DRAM has been proposed for use as a large, high-bandwidth, last-level cache with hundreds or thousands of megabytes of capacity. Not all workloads (or phases) can produ…