On Sampling Strategies for Spectral Model Sharding

Denis Korzhenkov, Christos Louizos

The problem of heterogeneous clients in federated learning has recently drawn a lot of attention. Spectral model sharding, i.e., partitioning the model parameters into low-rank mat…