Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
SDS-LoRA: Overcoming Anisotropic Gradient Scaling in Low-Rank Adaptation
Junghun Oh, Sungyong Baik, Kyoung Mu Lee
Low-Rank Adaptation (LoRA) enables efficient adaptation of large pretrained models to downstream tasks by parameterizing weight updates with low-rank matrices. In this paper, we in…
cs.LG2025
Find A Winning Sign: Sign Is All We Need to Win the Lottery
Junghun Oh, Sungyong Baik, Kyoung Mu Lee
The Lottery Ticket Hypothesis (LTH) posits the existence of a sparse subnetwork (a.k.a. winning ticket) that can generalize comparably to its over-parameterized counterpart when tr…