2 citations · 2 across the 2 of their papers we have counts for
2 papers
cs.DC2026
Fast Recovery for LLM Serving via Decoupled Device Memory Lifetime in Dynamo
Schwinn Saereesitthipitak, Mohammed Abdulwahhab, Hannah Zhang +6
Large language model (LLM) inference replicas run across tightly coupled GPUs and serve traffic continuously for weeks. Hardware and software failures are therefore inevitable, and…
cs.LG2020★ 2 cited
KD-Lib: A PyTorch library for Knowledge Distillation, Pruning and Quantization
Het Shah, Avishree Khare, Neelay Shah +1
In recent years, the growing size of neural networks has led to a vast amount of research concerning compression techniques to mitigate the drawbacks of such large sizes. Most of t…