21 citations
2 papers
cs.CL2022★ 2 cited
LittleBird: Efficient Faster & Longer Transformer for Question Answering
Minchul Lee, Kijong Han, Myeong Cheol Shin
BERT has shown a lot of sucess in a wide variety of NLP tasks. But it has a limitation dealing with long inputs due to its attention mechanism. Longformer, ETC and BigBird addresse…
cs.LG2021★ 21 cited
Connecting Low-Loss Subspace for Personalized Federated Learning
Seok-Ju Hahn, Minwoo Jeong, Junghye Lee
Due to the curse of statistical heterogeneity across clients, adopting a personalized federated learning method has become an essential choice for the successful deployment of fede…