4 papers
From Atoms to Entropy: Optimal Noise Allocation for Diffusion Training in the Convex Regime
Luca Ambrogioni, Giulio Franzese, Alberto Foresti +7
How should a diffusion model decide which noise levels to train on, and how much? Despite the importance of this choice, current noise schedules are based largely on heuristics or…
CoBit: Language Modeling with Bitstream Diffusion
Georgios Batzolis, Mark Girolami, Luca Ambrogioni
Diffusion language models (DLMs) promise parallel, order-agnostic generation, but on standard benchmarks they have historically lagged behind autoregressive models in sample qualit…
Noise Scheduling as Information-Guided Allocation in Diffusion Training
Gabriel Raya, Bac Nguyen, Georgios Batzolis +6
We introduce InfoNoise, an online adaptive noise schedule for diffusion training that reallocates optimization effort toward noise levels where denoising is most informative. Toget…
Score-based Pullback Riemannian Geometry: Extracting the Data Manifold Geometry using Anisotropic Flows
Willem Diepeveen, Georgios Batzolis, Zakhar Shumaylov +1
Data-driven Riemannian geometry has emerged as a powerful tool for interpretable representation learning, offering improved efficiency in downstream tasks. Moving forward, it is cr…