2 papers
cs.CL2020
What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding
Yu-An Wang, Yun-Nung Chen
In recent years, pre-trained Transformers have dominated the majority of NLP benchmark tasks. Many variants of pre-trained Transformers have kept breaking out, and most focus on de…
cs.AI2018
Modeling Melodic Feature Dependency with Modularized Variational Auto-Encoder
Yu-An Wang, Yu-Kai Huang, Tzu-Chuan Lin +2
Automatic melody generation has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melodies has turned out to be highly cha…