24 citations · 39 across the 7 of their papers we have counts for
8 papers
Tricks from Deep Learning
Atılım Güneş Baydin, Barak A. Pearlmutter, Jeffrey Mark Siskind
The deep learning community has devised a diverse set of methods to make gradient optimization, using large datasets, of large and highly complex models with deeply cascaded nonlin…
Evolving the Incremental λ Calculus into a Model of Forward Automatic Differentiation (AD)
Robert Kelly, Barak A. Pearlmutter, Jeffrey Mark Siskind
Formal transformations somehow resembling the usual derivative are surprisingly common in computer science, with two notable examples being derivatives of regular expressions and d…
Efficient Implementation of a Higher-Order Language with Built-In AD
Jeffrey Mark Siskind, Barak A. Pearlmutter
We show that Automatic Differentiation (AD) operators can be provided in a dynamic language without sacrificing numeric performance. To achieve this, general forward and reverse AD…
Binomial Checkpointing for Arbitrary Programs with No User Annotation
Jeffrey Mark Siskind, Barak A. Pearlmutter
Heretofore, automatic checkpointing at procedure-call boundaries, to reduce the space complexity of reverse mode, has been provided by systems like Tapenade. However, binomial chec…
The Compositional Nature of Event Representations in the Human Brain
Andrei Barbu, N. Siddharth, Caiming Xiong +10
How does the human brain represent simple compositions of constituents: actors, verbs, objects, directions, and locations? Subjects viewed videos during neuroimaging (fMRI) session…
An Analysis of Publication Venues for Automatic Differentiation Research
Atilim Gunes Baydin, Barak A. Pearlmutter
We present the results of our analysis of publication venues for papers on automatic differentiation (AD), covering academic journals and conference proceedings. Our data are colle…