2 papers
cs.CL2020
Optimizing Deeper Transformers on Small Datasets
Peng Xu, Dhruv Kumar, Wei Yang +6
It is a common belief that training deep transformers from scratch requires large datasets. Consequently, for small datasets, people usually use shallow and simple additional layer…
stat.ML2019
Normalizing Flows: An Introduction and Review of Current Methods
Ivan Kobyzev, Simon J. D. Prince, Marcus A. Brubaker
Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact. The goal of this survey article…