Showing cs.DCShow all
3 papers · 1 filter
cs.DC2026
Tessera: Demand-Driven KV Cache Management for Retrieval-Augmented LLM Serving
Fei Fang, Chung-Hsiang Lo, Yi Liu +2
RAG and retrieval-based agent memory both inject retrieved content into LLM prompts, as document chunks and recalled memory records, respectively. The same content can recur across…
cs.DC2025
PlanetServe: A Decentralized, Scalable, and Privacy-Preserving Overlay for Democratizing Large Language Model Serving
Fei Fang, Yifan Hua, Shengze Wang +4
While significant progress has been made in research and development on open-source and cost-efficient large-language models (LLMs), serving scalability remains a critical challeng…
cs.DC2024
Towards Practical Overlay Networks for Decentralized Federated Learning
Yifan Hua, Jinlong Pang, Xiaoxue Zhang +5
Decentralized federated learning (DFL) uses peer-to-peer communication to avoid the single point of failure problem in federated learning and has been considered an attractive solu…