3 citations · 6 across the 7 of their papers we have counts for
Showing cs.DCShow all
2 papers · 1 filter
cs.DC2025
Dynamic Rebatching for Efficient Early-Exit Inference with DREX
Xuting Liu, Daniel Alexander, Siva Kesava Reddy Kakarla +2
Early-Exit (EE) is a Large Language Model (LLM) architecture that accelerates inference by allowing easier tokens to be generated using only a subset of the model's layers. However…
cs.DC2025
The Dawn of Disaggregation and the Coherence Conundrum: A Call for Federated Coherence
Jaewan Hong, Marcos K. Aguilera, Emmanuel Amaro +3
Disaggregated memory is an upcoming data center technology that will allow nodes (servers) to share data efficiently. Sharing data creates a debate on the level of cache coherence…