5 papers · 1 filter
SimpleDesign: A Joint Model for Protein Sequence and Structure Codesign
Jiarui Lu, Yuyang Wang, Yizhe Zhang +4
Proteins are fundamental to biological processes, with their function determined by the complex interplay between the amino acid sequence and the three-dimensional structure. Devel…
A Mechanistic Study of Algorithmic Generalization in Diffusion Models on Modular Arithmetic
Joon Hyeok Kim, Yong-Hyun Park, Mattis Dalsætra Østby +1
Despite their empirical success, how diffusion models generalize remains poorly understood from a mechanistic perspective. In this work, we provide a controlled mechanistic account…
The Coupling Within: Flow Matching via Distilled Normalizing Flows
David Berthelot, Tianrong Chen, Jiatao Gu +6
Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration ste…
Adaptivity and Modularity for Efficient Generalization Over Task Complexity
Samira Abnar, Omid Saremi, Laurent Dinh +8
Can transformers generalize efficiently on problems that require dealing with examples with different levels of difficulty? We introduce a new task tailored to assess generalizatio…
Generative Modeling with Phase Stochastic Bridges
Tianrong Chen, Jiatao Gu, Laurent Dinh +3
Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie,…