517 citations · 746 across the 18 of their papers we have counts for
3 papers · 1 filter
Sparse DETR: Efficient End-to-End Object Detection with Learnable Sparsity
Byungseok Roh, JaeWoong Shin, Wuhyun Shin +1
DETR is the first end-to-end object detector using a transformer encoder-decoder architecture and demonstrates competitive performance but low computational efficiency on high reso…
Automated Learning Rate Scheduler for Large-batch Training
Chiheon Kim, Saehoon Kim, Jongmin Kim +2
Large-batch training has been essential in leveraging large-scale datasets and models in deep learning. While it is computationally beneficial to use large batch sizes, it often re…
Hybrid Generative-Contrastive Representation Learning
Saehoon Kim, Sungwoong Kim, Juho Lee
Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There ar…