62 citations · 116 across the 14 of their papers we have counts for
3 papers · 1 filter
Unigram-Normalized Perplexity as a Language Model Performance Measure with Different Vocabulary Sizes
Jihyeon Roh, Sang-Hoon Oh, Soo-Young Lee
Although Perplexity is a widely used performance metric for language models, the values are highly dependent upon the number of words in the corpus and is useful to compare perform…
Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models
Jihyeon Roh, Huiseong Gim, Soo-Young Lee
We report a GPT-based multi-sentence language model for dialogue generation and document understanding. First, we propose a hierarchical GPT which consists of three blocks, i.e., a…
Semi-supervised Disentanglement with Independent Vector Variational Autoencoders
Bo-Kyeong Kim, Sungjin Park, Geonmin Kim +1
We aim to separate the generative factors of data into two latent vectors in a variational autoencoder. One vector captures class factors relevant to target classification tasks, w…