17 citations · 29 across the 15 of their papers we have counts for
4 papers · 1 filter
Gaussian Flow-Matching Schedules: Implications for Sampling and Training
Arsène Claustre, Hugo Negrel, Claire Boyer +2
Flow-matching schedules affect both sampling dynamics and the variance of the regression target. For centered commuting Gaussians, we show that a direction-dependent schedule decom…
Balanced LoRA: Removing Parameter Invariance to Accelerate Convergence
Valérie Castin, Kimia Nadjahi, Pierre Ablin +1
Low-Rank Adaptation (LoRA) is the most widely adopted method for fine-tuning large language models. Notably, LoRA is inherently overparameterized: multiple pairs of low-rank factor…
Expected Batch Optimal Transport Plans and Consequences for Flow Matching
Samuel Boïté, Julie Delon, Kimia Nadjahi
Solving optimal transport (OT) on random minibatches is a common surrogate for exact OT in large-scale learning. In flow matching (FM), this surrogate is used to obtain OT-like cou…
Convergence Rates for Distribution Matching with Sliced Optimal Transport
Gauthier Thurin, Claire Boyer, Kimia Nadjahi
We study the slice-matching scheme, an efficient iterative method for distribution matching based on sliced optimal transport. We investigate convergence to the target distribution…