Predicting Block-Coordinate Performance via Cross-Curvature

Shengkun Zhu, Jinshan Zeng, Zhiqiang Kou +2

Simultaneous and sequential block updates are two basic optimization strategies used across machine learning, such as neural-network training, federated learning, and low-rank adap…