64 citations · 176 across the 23 of their papers we have counts for
10 papers · 1 filter
Eliciting Weak-to-Strong Generalization with On-Policy Reverse Distillation
Youngrok Park, Sangmin Bae, Hojung Jung +6
Weak-to-strong generalization asks whether stronger models can learn from weaker supervisors and surpass them. This is particularly important for successive model generations and m…
Bastion: Budget-Aware Speculative Decoding with Tree-structured Block Diffusion Drafting
Soowon Oh, Nam Cao, Yujin Kim +4
Block-diffusion drafters have recently emerged as a powerful alternative for speculative decoding by predicting multiple future-token distributions in a single parallel step. Howev…
Temporal Alignment Guidance: On-Manifold Sampling in Diffusion Models
Youngrok Park, Hojung Jung, Sangmin Bae +1
Diffusion models have achieved remarkable success as generative models. However, even a well-trained model can accumulate errors throughout the generation process. These errors bec…
Automated Filtering of Human Feedback Data for Aligning Text-to-Image Diffusion Models
Yongjin Yang, Sihyeon Kim, Hojung Jung +4
Fine-tuning text-to-image diffusion models with human feedback is an effective method for aligning model behavior with human intentions. However, this alignment process often suffe…
Fine-tuned In-Context Learning Transformers are Excellent Tabular Data Classifiers
Felix den Breejen, Sangmin Bae, Stephen Cha +1
The recently introduced TabPFN pretrains an In-Context Learning (ICL) transformer on synthetic data to perform tabular data classification. In this work, we extend TabPFN to the fi…
Fine-Tuning the Retrieval Mechanism for Tabular Deep Learning
Felix den Breejen, Sangmin Bae, Stephen Cha +3
While interests in tabular deep learning has significantly grown, conventional tree-based models still outperform deep learning methods. To narrow this performance gap, we explore…
Self-Contrastive Learning: Single-viewed Supervised Contrastive Framework using Sub-network
Sangmin Bae, Sungnyun Kim, Jongwoo Ko +3
Contrastive loss has significantly improved performance in supervised classification tasks by using a multi-viewed framework that leverages augmentation and label information. The…
Preservation of the Global Knowledge by Not-True Distillation in Federated Learning
Gihun Lee, Minchan Jeong, Yongjin Shin +2
In federated learning, a strong global model is collaboratively learned by aggregating clients' locally trained models. Although this precludes the need to access clients' data dir…
Accurate and Fast Federated Learning via Combinatorial Multi-Armed Bandits
Taehyeon Kim, Sangmin Bae, Jin-woo Lee +1
Federated learning has emerged as an innovative paradigm of collaborative machine learning. Unlike conventional machine learning, a global model is collaboratively learned while da…
SIPA: A Simple Framework for Efficient Networks
Gihun Lee, Sangmin Bae, Jaehoon Oh +1
With the success of deep learning in various fields and the advent of numerous Internet of Things (IoT) devices, it is essential to lighten models suitable for low-power devices. I…