5 citations · 9 across the 2 of their papers we have counts for
4 papers
A Generalized Lottery Ticket Hypothesis
Ibrahim Alabdulmohsin, Larisa Markeeva, Daniel Keysers +1
We introduce a generalization to the lottery ticket hypothesis in which the notion of "sparsity" is relaxed by choosing an arbitrary basis in the space of parameters. We present ev…
Towards Understanding Normalization in Neural ODEs
Julia Gusak, Larisa Markeeva, Talgat Daulbaev +3
Normalization is an important and vastly investigated technique in deep learning. However, its role for Ordinary Differential Equation based networks (neural ODEs) is still poorly…
Interpolation Technique to Speed Up Gradients Propagation in Neural ODEs
Talgat Daulbaev, Alexandr Katrutsa, Larisa Markeeva +3
We propose a simple interpolation-based method for the efficient approximation of gradients in neural ODE models. We compare it with the reverse dynamic method (known in the litera…
MUSCO: Multi-Stage Compression of neural networks
Julia Gusak, Maksym Kholiavchenko, Evgeny Ponomarev +3
The low-rank tensor approximation is very promising for the compression of deep neural networks. We propose a new simple and efficient iterative approach, which alternates low-rank…