Distributed Newton-Type Methods with Communication Compression and Bernoulli Aggregation

Rustem Islamov, Xun Qian, Slavomír Hanzely +2

Despite their high computation and communication costs, Newton-type methods remain an appealing option for distributed training due to their robustness against ill-conditioned conv…