4 papers
CHAD: Combinatory Homomorphic Automatic Differentiation
Matthijs Vákár, Tom Smeding
We introduce Combinatory Homomorphic Automatic Differentiation (CHAD), a principled, pure, provably correct define-then-run method for performing forward- and reverse-mode automati…
Dual-Numbers Reverse AD for Functional Array Languages
Tom Smeding, MikoÅaj Konarski, Simon Peyton Jones +1
The standard dual-numbers construction works well for forward-mode automatic differentiation (AD) and is attractive due to its simplicity; recently, it also has been adapted to rev…
Comparing Parallel Functional Array Languages: Programming and Performance
David van Balen, Tiziano De Matteis, Clemens Grelck +12
Parallel functional array languages are an emerging class of programming languages that promise to combine low-effort parallel programming with good performance and performance por…
Parallel Dual-Numbers Reverse AD
Tom Smeding, Matthijs Vákár
Where dual-numbers forward-mode automatic differentiation (AD) pairs each scalar value with its tangent value, dual-numbers reverse-mode AD attempts to achieve reverse AD using a s…