23 citations · 57 across the 37 of their papers we have counts for
3 papers · 1 filter
The RNN Homunculus: Learning to Gate Long-Term Memory
Zeyu Fan, Alexandru-Dragos Manolache, Jan van Gemert
Learning long-range dependencies with recurrent neural networks (RNNs) is difficult because of the vanishing gradient problem. Gated recurrent neural networks like GRUs and LSTMs a…
On Hyperparameter Tuning on the Test Set
Matteo Fregonara, Tom Viering, Jan van Gemert
"Don't tune hyperparameters on the test set" is often stated in machine learning textbooks. Violating it is considered a cardinal sin that produces misleadingly optimistic results,…
Equal Bits: Enforcing Equally Distributed Binary Network Weights
Yunqiang Li, Silvia L. Pintea, Jan C. van Gemert
Binary networks are extremely efficient as they use only two symbols to define the network: . One can make the prior distribution of these symbols a design choice. The r…