193 citations · 348 across the 28 of their papers we have counts for
5 papers · 1 filter
Learning -Powered Conditional Distributions with Importance-Weighted Flow Matching
Maciej Falkiewicz, Frantzeska Lavda, Jason Ramapuram +1
Classifier-Free Guidance (CFG) with guidance scale is commonly motivated by the -powered conditional distribution obtained by setting , but CFG does not, in general, sa…
Scaling Properties of Continuous Diffusion Spoken Language Models
Jason Ramapuram, Eeshan Gunesh Dhekane, Amitis Shidani +6
Speech-only spoken language models (SLMs) lag behind text and text-speech models in performance, with recent discrete autoregressive (AR) SLMs indicating significant computational…
Path-Constrained Mixture-of-Experts
Zijin Gu, Tatiana Likhomanenko, Vimal Thilak +2
Sparse Mixture-of-Experts (MoE) architectures route each token through a subset of experts at each layer independently. We propose viewing MoE computation through the lens of \emph…
The Design Space of Tri-Modal Masked Diffusion Models
Louis Bethune, Victor Turrisi, Bruno Kacper Mlodozeniec +21
Discrete diffusion models have emerged as strong alternatives to autoregressive language models, with recent work initializing and fine-tuning a base unimodal model for bimodal gen…
A Small-Scale System for Autoregressive Program Synthesis Enabling Controlled Experimentation
Russ Webb, Jason Ramapuram
What research can be pursued with small models trained to complete true programs? Typically, researchers study program synthesis via large language models (LLMs) which introduce is…