Tempo: Compiled Dynamic Deep Learning with Symbolic Dependence Graphs

Pedro F. Silvestre, Peter Pietzuch

Deep learning (DL) algorithms are often defined in terms of temporal relationships: a tensor at one timestep may depend on tensors from earlier or later timesteps. Such dynamic dep…