4 papers
Sticky Jump Diffusions: A Unifying View of Masked, Continuous, and Hybrid Diffusion
Pascal Jutras-Dubé, Patrick Pynadath, Jeremy Lu +2
We introduce Sticky Jump Diffusions (SJDs), continuous-time Markov processes on whose discrete anchors are token embeddings. In forward time, anchors release their ma…
Single-Step Consistent Diffusion Samplers
Pascal Jutras-Dubé, Patrick Pynadath, Ruqi Zhang
Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterat…
Dynamic Obstacle Avoidance through Uncertainty-Based Adaptive Planning with Diffusion
Vineet Punyamoorty, Pascal Jutras-Dubé, Ruqi Zhang +3
By framing reinforcement learning as a sequence modeling problem, recent work has enabled the use of generative models, such as diffusion models, for planning. While these models a…
AffectEcho: Speaker Independent and Language-Agnostic Emotion and Affect Transfer for Speech Synthesis
Hrishikesh Viswanath, Aneesh Bhattacharya, Pascal Jutras-Dubé +4
Affect is an emotional characteristic encompassing valence, arousal, and intensity, and is a crucial attribute for enabling authentic conversations. While existing text-to-speech (…