Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Gradient dynamics for low-rank fine-tuning beyond kernels
Arif Kerem Dayi, Sitan Chen
LoRA has emerged as one of the de facto methods for fine-tuning foundation models with low computational cost and memory footprint. The idea is to only train a low-rank perturbatio…
cs.LG2024
What does guidance do? A fine-grained analysis in a simple setting
Muthu Chidambaram, Khashayar Gatmiry, Sitan Chen +2
The use of guidance in diffusion models was originally motivated by the premise that the guidance-modified score is that of the data distribution tilted by a conditional likelihood…