38 citations · 78 across the 4 of their papers we have counts for
4 papers
A Character-Word Compositional Neural Language Model for Finnish
Matti Lankinen, Hannes Heikinheimo, Pyry Takala +2
Inspired by recent research, we explore ways to model the highly morphological Finnish language at the level of characters while maintaining the performance of word-level models. W…
Denoising autoencoder with modulated lateral connections learns invariant representations of natural images
Antti Rasmus, Tapani Raiko, Harri Valpola
Suitable lateral connections between encoder and decoder are shown to allow higher layers of a denoising autoencoder (dAE) to focus on invariant representations. In regular autoenc…
Techniques for Learning Binary Stochastic Feedforward Neural Networks
Tapani Raiko, Mathias Berglund, Guillaume Alain +1
Stochastic binary hidden units in a multi-layer perceptron (MLP) network give at least three potential benefits when compared to deterministic MLP networks. (1) They allow to learn…
Iterative Neural Autoregressive Distribution Estimator (NADE-k)
Tapani Raiko, Li Yao, Kyunghyun Cho +1
Training of the neural autoregressive density estimator (NADE) can be viewed as doing one step of probabilistic inference on missing values in data. We propose a new model that ext…