2 citations · 8 across the 11 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021
Maximizing Efficiency of Language Model Pre-training for Learning Representation
Junmo Kang, Suwon Shin, Jeonghwan Kim +2
Pre-trained language models in the past years have shown exponential growth in model parameters and compute time. ELECTRA is a novel approach for improving the compute efficiency o…
cs.CL2021
Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval
Kyoung-Rok Jang, Junmo Kang, Giwon Hong +4
The semantic matching capabilities of neural information retrieval can ameliorate synonymy and polysemy problems of symbolic approaches. However, neural models' dense representatio…