4 papers
Gradient Descent with Large Step Size Restores Symmetry in Deep Linear Networks with Multi-Pathway
Hee-Sung Kim, Sungyoon Lee
Recent analyses of multi-pathway Deep Linear Networks use Gradient Flow to predict a "winner-takes-all" specialization in which path symmetry breaks and each feature concentrates i…
Inconsistency-Aware Minimization: Improving Generalization with Unlabeled Data
Hee-Sung Kim, Hyeonseong Kim, Sungyoon Lee
Estimating the generalization gap and developing optimization methods that improve generalization are crucial for deep learning models, for both theoretical understanding and pract…
Parallel Tempering Initial Sampling in Inference-Time Reward Alignment
Myeongjun Oh, Gwangho Kim, Sungyoon Lee
Inference-time reward alignment steers pretrained diffusion and flow-based generative models to satisfy user-specified rewards without retraining. Recently, Sequential Monte Carlo…
Localizing Memorized Regions in Diffusion Models via Coordinate-Wise Curvature Differences
Gwangho Kim, Sungyoon Lee
Diffusion models can unintentionally memorize training samples, raising concerns about privacy and copyright. While recent methods can detect memorization, they often rely on globa…