14 citations · 16 across the 4 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 14 cited
Enabling Large Batch Size Training for DNN Models Beyond the Memory Limit While Maintaining Performance
XinYu Piao, DoangJoo Synn, JooYoung Park +1
Recent deep learning models are difficult to train using a large batch size, because commodity machines may not have enough memory to accommodate both the model and a large data ba…
cs.CL2021★ 1 cited
Contextual Skipgram: Training Word Representation Using Context Information
Dongjae Kim, Jong-Kook Kim
The skip-gram (SG) model learns word representation by predicting the words surrounding a center word from unstructured text data. However, not all words in the context window cont…