2 papers
cs.CL2021
Maximizing Efficiency of Language Model Pre-training for Learning Representation
Junmo Kang, Suwon Shin, Jeonghwan Kim +2
Pre-trained language models in the past years have shown exponential growth in model parameters and compute time. ELECTRA is a novel approach for improving the compute efficiency o…
cs.CL2020
Leveraging Order-Free Tag Relations for Context-Aware Recommendation
Junmo Kang, Jeonghwan Kim, Suwon Shin +1
Tag recommendation relies on either a ranking function for top- tags or an autoregressive generation method. However, the previous methods neglect one of two seemingly conflicti…