activity
20242026
most citedThe Future of Large Language Model Pre-training is Federated

4 citations · 7 across the 9 of their papers we have counts for

collaborators
Showing 2026Show all

5 papers · 1 filter

cs.DC2026

From Pilots to Production: Lessons in Cross-Institutional Federated Training and Artificial Intelligence for Science

Olivera Kotevska, Max Carlson, Yan Gao +10

Many of the most valuable scientific datasets cannot be centralized: they are proprietary, export-controlled, classified, or bound by data-sovereignty restrictions. This inverts th…

cs.LG2026

Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deployment

Yan Gao, Mohammad Naseri, Javier Fernandez-Marques +19

Federated learning (FL) has emerged as a key approach for training models across decentralized data, yet benchmarking in FL remains difficult to reproduce, compare, and extend. Exi…

cs.LG2026

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs

Lorenzo Sani, Zeyu Cao, Meghdad Kurmanji +5

Pre-training Large Language Models (LLMs) typically demands large-scale infrastructure with tightly coupled hardware accelerators. Mixture-of-Experts (MoEs) architectures partially…

cs.CL2026

EdgeFlowerTune: Evaluating Federated LLM Fine-Tuning Under Realistic Edge System Constraints

Jiaxiang Geng, Yiyi Lu, Lunyu Zhao +3

Federated fine-tuning offers a promising paradigm for adapting large language models (LLMs) on edge devices by leveraging the rich, diverse, and continuously generated data from sm…

eess.AS2026

Adaptive Federated Fine-Tuning of Self-Supervised Speech Representations

Xin Guo, Chunrui Zhao, Hong Jia +4

Integrating Federated Learning (FL) with self-supervised learning (SSL) enables privacy-preserving fine-tuning for speech tasks. However, federated environments exhibit significant…