18 citations · 19 across the 5 of their papers we have counts for
3 papers · 1 filter
What Does a Discrete Diffusion Model Learn? One Reverse Process in Three Coordinates
Rodrigo Casado Noguerales, Bernhard Schölkopf, Thomas Hofmann +1
What does a discrete diffusion model actually learn? The literature trains denoisers, bridge plug-ins, and concrete scores, each deriving its own ELBO objective under different con…
Scaling Behavior of Discrete Diffusion Language Models
Dimitri von Rütte, Janis Fluri, Omead Pooladzandi +3
Modern LLM pre-training consumes vast amounts of compute and training data, making the scaling behavior, or scaling laws, of different models a key distinguishing factor. Discrete…
On the effectiveness of Randomized Signatures as Reservoir for Learning Rough Dynamics
Enea Monzio Compagnoni, Anna Scampicchio, Luca Biggio +3
Many finance, physics, and engineering phenomena are modeled by continuous-time dynamical systems driven by highly irregular (stochastic) inputs. A powerful tool to perform time se…