most citedPrima.cpp: Fast 30-70B LLM Inference on Heterogeneous and Low-Resource Home Clusters

1 citations · 1 across the 5 of their papers we have counts for

collaborators
Showing cs.NIShow all

2 papers · 1 filter

cs.NI2026

SplitCom: Communication-efficient Split Federated Fine-tuning of LLMs via Temporal Compression

Tao Li, Yulin Tang, Yiyang Song +4

Federated fine-tuning of on-device large language models (LLMs) mitigates privacy concerns by preventing raw data sharing. However, the intensive computational and memory demands p…

cs.NI2025

SLIDE: Simultaneous Model Downloading and Inference at the Wireless Network Edge

Guanqiao Qu, Tao Li, Qian Chen +2

To support on-device inference, the next-generation mobile networks are expected to support real-time model downloading services to mobile users. However, powerful AI models typica…