Sparse Allreduce: Efficient Scalable Communication for Power-Law Data

Huasha Zhao, John Canny

Many large datasets exhibit power-law statistics: The web graph, social networks, text data, click through data etc. Their adjacency graphs are termed natural graphs, and are known…