Multi-pretrained Deep Neural Network

Zhen Hu, Zhuyin Xue, Tong Cui +2

Pretraining is widely used in deep neutral network and one of the most famous pretraining models is Deep Belief Network (DBN). The optimization formulas are different during the pr…