Is Oracle Pruning the True Oracle?

Sicheng Feng, Keda Tao, Huan Wang

Oracle pruning, which selects unimportant weights by minimizing the pruned train loss, has served as the foundation for most neural network pruning methods for over thirty-five yea…