A Step-by-step Introduction to the Implementation of Automatic Differentiation

Yu-Hsueh Fang, He-Zhe Lin, Jie-Jyun Liu +1

Automatic differentiation is a key component in deep learning. This topic is well studied and excellent surveys such as Baydin et al. (2018) have been available to clearly describe…