11 papers
Routing Without Training: Controllable-Ratio LLM Offloading via Reliability Gating
Evan Chen, Shiqiang Wang, Kevin S Chan +2
Local-cloud collaboration is a practical way to deploy large language models under resource constraints, but existing methods often rely on trained routers or collaboration-aware f…
Bridging On-Device and Cloud LLMs for Collaborative Reasoning: A Unified Methodology for Local Routing and Post-Training
Wenzhi Fang, Dong-Jun Han, Liangqi Yuan +2
Device-cloud collaboration holds promise for deploying large language models (LLMs), leveraging lightweight on-device models for efficiency while relying on powerful cloud models f…
A Hierarchical Gradient Tracking Algorithm for Mitigating Subnet-Drift in Fog Learning Networks
Evan Chen, Shiqiang Wang, Christopher G. Brinton
Federated learning (FL) encounters scalability challenges when implemented over fog networks that do not follow FL's conventional star topology architecture. Semi-decentralized FL…
Joint Continual Learning of Local Language Models and Cloud Offloading Decisions with Budget Constraints
Evan Chen, Wenzhi Fang, Shiqiang Wang +1
Locally deployed Small Language Models (SLMs) must continually support diverse tasks under strict memory and computation constraints, making selective reliance on cloud Large Langu…
Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimization
Jianing Zhang, Evan Chen, Dong-Jun Han +2
Vertical Federated Learning (VFL) enables collaborative model training across feature-partitioned devices, yet its reliance on device-server information exchange introduces signifi…
Differentially-Private Multi-Tier Federated Learning: A Formal Analysis and Evaluation
Evan Chen, Frank Po-Chen Lin, Dong-Jun Han +1
While federated learning (FL) eliminates the transmission of raw data over a network, it is still vulnerable to privacy breaches from the communicated model parameters. Differentia…