112 citations · 552 across the 46 of their papers we have counts for
8 papers · 1 filter
Augmented Bridge Matching
Valentin De Bortoli, Guan-Horng Liu, Tianrong Chen +2
Flow and bridge matching are a novel class of processes which encompass diffusion models. One of the main aspect of their increased flexibility is that these models can interpolate…
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Shuaiwen Leon Song, Bonnie Kruft, Minjia Zhang +89
In the upcoming decade, deep learning may revolutionize the natural sciences, enhancing our capacity to model and predict natural occurrences. This could herald a new era of scient…
Improving Generative Model-based Unfolding with Schrödinger Bridges
Sascha Diefenbacher, Guan-Horng Liu, Vinicius Mikuni +2
Machine learning-based unfolding has enabled unbinned and high-dimensional differential cross section measurements. Two main approaches have emerged in this research area: one base…
Fast Training of Diffusion Models with Masked Transformers
Hongkai Zheng, Weili Nie, Arash Vahdat +1
We propose an efficient approach to train large diffusion models with masked transformers. While masked transformers have been extensively explored for representation learning, the…
Defending against Adversarial Audio via Diffusion Model
Shutong Wu, Jiongxiao Wang, Wei Ping +2
Deep learning models have been widely used in commercial acoustic systems in recent years. However, adversarial audio examples can cause abnormal behaviors for those acoustic syste…
ISB: Image-to-Image Schrödinger Bridge
Guan-Horng Liu, Arash Vahdat, De-An Huang +3
We propose Image-to-Image Schrödinger Bridge (ISB), a new class of conditional diffusion models that directly learn the nonlinear diffusion processes between two given distribu…
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning
Zhuolin Yang, Wei Ping, Zihan Liu +13
Augmenting pretrained language models (LMs) with a vision encoder (e.g., Flamingo) has obtained the state-of-the-art results in image-to-text generation. However, these models stor…
A Text-guided Protein Design Framework
Shengchao Liu, Yanjing Li, Zhuoxinran Li +10
Current AI-assisted protein design mainly utilizes protein sequential and structural information. Meanwhile, there exists tremendous knowledge curated by humans in the text format…