2 citations · 2 across the 2 of their papers we have counts for
2 papers
cs.LG2022★ 2 cited
Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost
Sungjun Cho, Seonwoo Min, Jinwoo Kim +3
To overcome the quadratic cost of self-attention, recent works have proposed various sparse attention modules, most of which fall under one of two groups: 1) sparse attention under…
cs.CV2022
Improving Multi-fidelity Optimization with a Recurring Learning Rate for Hyperparameter Tuning
HyunJae Lee, Gihyeon Lee, Junhwan Kim +3
Despite the evolution of Convolutional Neural Networks (CNNs), their performance is surprisingly dependent on the choice of hyperparameters. However, it remains challenging to effi…