3 citations · 3 across the 3 of their papers we have counts for
3 papers
Inhibitory normalization of error signals improves learning in neural circuits
Roy Henha Eyono, Daniel Levenstein, Arna Ghosh +2
Normalization is a critical operation in neural circuits. In the brain, there is evidence that normalization is implemented via inhibitory interneurons and allows neural population…
AUTOKD: Automatic Knowledge Distillation Into A Student Architecture Family
Roy Henha Eyono, Fabio Maria Carlucci, Pedro M Esperança +2
State-of-the-art results in deep learning have been improving steadily, in good part due to the use of larger models. However, widespread use is constrained by device hardware limi…
Current State and Future Directions for Learning in Biological Recurrent Neural Networks: A Perspective Piece
Luke Y. Prince, Roy Henha Eyono, Ellen Boven +9
We provide a brief review of the common assumptions about biological learning with findings from experimental neuroscience and contrast them with the efficiency of gradient-based l…