14 citations · 15 across the 2 of their papers we have counts for
2 papers
cs.DC2024★ 1 cited
ENOVA: Autoscaling towards Cost-effective and Stable Serverless LLM Serving
Tao Huang, Pengfei Chen, Kyoka Gong +5
Since the increasing popularity of large language model (LLM) backend systems, it is common and necessary to deploy stable serverless serving of LLM on multi-GPU clusters with auto…
cs.CY2024★ 14 cited
Decentralized Social Networks and the Future of Free Speech Online
Tao Huang
Decentralized social networks like Mastodon and BlueSky are trending topics that have drawn much attention and discussion in recent years. By devolving powers from the central node…