Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
ReviveMoE: Fast Recovery for Hardware Failures in Large-Scale MoE LLM Inference Deployments
Haley Li, Xinglu Wang, Cong Feng +12
As LLM deployments scale over more hardware, the probability of a single failure in a system increases significantly, and cloud operators must consider robust countermeasures to ha…
cs.DC2023
Hibernate Container: A Deflated Container Mode for Fast Startup and High-density Deployment in Serverless Computing
Yulin Sun, Deepak Vij, Fenge Li +2
Serverless computing is a popular cloud computing paradigm, which requires low response latency to handle on-demand user requests. There are two prominent techniques employed for r…