1 citations · 1 across the 3 of their papers we have counts for
3 papers
HadamRNN: Binary and Sparse Ternary Orthogonal RNNs
Armand Foucault, Franck Mamalet, François Malgouyres
Binary and sparse ternary weights in neural networks enable faster computations and lighter representations, facilitating their use on edge devices with limited computational power…
Quantized Approximately Orthogonal Recurrent Neural Networks
Armand Foucault, Franck Mamalet, François Malgouyres
In recent years, Orthogonal Recurrent Neural Networks (ORNNs) have gained popularity due to their ability to manage tasks involving long-term dependencies, such as the copy-task, a…
A general approximation lower bound in norm, with applications to feed-forward neural networks
El Mehdi Achour, Armand Foucault, Sébastien Gerchinovitz +1
We study the fundamental limits to the expressive power of neural networks. Given two sets , of real-valued functions, we first prove a general lower bound on how well funct…