4 papers · 1 filter
A Tale of Two Learning Algorithms: Multiple Stream Random Walk and Asynchronous Gossip
Peyman Gholami, Hulya Seferoglu
Although gossip and random walk-based learning algorithms are widely known for decentralized learning, there has been limited theoretical and experimental analysis to understand th…
Model-Distributed Inference for Large Language Models at the Edge
Davide Macario, Hulya Seferoglu, Erdem Koyuncu
We introduce Model-Distributed Inference for Large-Language Models (MDI-LLM), a novel framework designed to facilitate the deployment of state-of-the-art large-language models (LLM…
Improved Generalization Bounds for Communication Efficient Federated Learning
Peyman Gholami, Hulya Seferoglu
This paper focuses on reducing the communication cost of federated learning by exploring generalization bounds and representation learning. We first characterize a tighter generali…
DIGEST: Fast and Communication Efficient Decentralized Learning with Local Updates
Peyman Gholami, Hulya Seferoglu
Two widely considered decentralized learning algorithms are Gossip and random walk-based learning. Gossip algorithms (both synchronous and asynchronous versions) suffer from high c…