15 citations · 32 across the 7 of their papers we have counts for
7 papers
Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention
Bin Gao, Zhuomin He, Puru Sharma +6
Interacting with humans through multi-turn conversations is a fundamental feature of large language models (LLMs). However, existing LLM serving engines executing multi-turn conver…
numaPTE: Managing Page-Tables and TLBs on NUMA Systems
Bin Gao, Qingxuan Kang, Hao-Wei Tee +3
Memory management operations that modify page-tables, typically performed during memory allocation/deallocation, are infamous for their poor performance in highly threaded applicat…
Efficiently Enabling Block Semantics and Data Updates in DNA Storage
Puru Sharma, Cheng-Kai Lim, Dehui Lin +2
We propose a novel and flexible DNA-storage architecture, which divides the storage space into fixed-size units (blocks) that can be independently and efficiently accessed at rando…
Managing Reliability Skew in DNA Storage
Dehui Lin, Yasamin Tabatabaee, Yash Pote +1
DNA is emerging as an increasingly attractive medium for data storage due to a number of important and unique advantages it offers, most notably the unprecedented durability and de…
SPARTA: A Divide and Conquer Approach to Address Translation for Accelerators
Javier Picorel, Seyed Alireza Sanaee Kohroudi, Zi Yan +3
Virtual memory (VM) is critical to the usability and programmability of hardware accelerators. Unfortunately, implementing accelerator VM efficiently is challenging because the are…
Exploiting Errors for Efficiency: A Survey from Circuits to Algorithms
Phillip Stanley-Marbell, Armin Alaghi, Michael Carbin +13
When a computational task tolerates a relaxation of its specification or when an algorithm tolerates the effects of noise in its execution, hardware, programming languages, and sys…
Near-Memory Address Translation
Javier Picorel, Djordje Jevdjic, Babak Falsafi
Memory and logic integration on the same chip is becoming increasingly cost effective, creating the opportunity to offload data-intensive functionality to processing units placed i…