Towards Denotational Semantics of AD for Higher-Order, Recursive, Probabilistic Languages

Alexander K. Lew, Mathieu Huot, Vikash K. Mansinghka

Automatic differentiation (AD) aims to compute derivatives of user-defined functions, but in Turing-complete languages, this simple specification does not fully capture AD's behavi…