5 papers
Retrospective Distillation Attribution via Normalized Response Similarity
Minwoo Jang, Jaechang Kim, Minhyeon Oh +2
Model distillation transfers capabilities through supervised fine-tuning (SFT) on teacher responses, often collected from commercial APIs, raising questions of model provenance. Ex…
Federated Variational Preference Alignment with Gumbel-Softmax Prior for Personalized User Preferences
Jabin Koo, Hoyoung Kim, Minwoo Jang +1
Federated Learning (FL) offers a privacy-preserving pathway for aligning Large Language Models (LLMs); however, existing frameworks typically enforce a monolithic reward model, ine…
ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets
Hoyoung Kim, Minwoo Jang, Jabin Koo +2
Beyond general recognition tasks, specialized domains and fine-grained settings often encounter data scarcity, especially for tail classes. To obtain less biased and more reliable…
Making Models Unmergeable via Scaling-Sensitive Loss Landscape
Minwoo Jang, Hoyoung Kim, Jabin Koo +1
The rise of model hubs has made it easier to access reusable model components, making model merging a practical tool for combining capabilities. Yet, this modularity also creates a…
Towards Robust and Efficient Federated Low-Rank Adaptation with Heterogeneous Clients
Jabin Koo, Minwoo Jang, Jungseul Ok
Federated fine-tuning for Large Language Models (LLMs) faces significant challenges due to the heavy communication overhead of transmitting large model updates. Although Low Rank A…