activity
20212023
most citedVLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts

288 citations · 556 across the 8 of their papers we have counts for

collaborators

8 papers

q-bio.BM2023★ 11 cited

MolDiff: Addressing the Atom-Bond Inconsistency Problem in 3D Molecule Diffusion Generation

Xingang Peng, Jiaqi Guan, Qiang Liu +1

Deep generative models have recently achieved superior performance in 3D molecule generation. Most of them first generate atoms and then add chemical bonds based on the generated a…

cs.CV2022

Fast Point Cloud Generation with Straight Flows

Lemeng Wu, Dilin Wang, Chengyue Gong +6

Diffusion models have emerged as a powerful tool for point cloud generation. A key component that drives the impressive performance for generating high-quality samples from noise i…

cs.CV2022★ 1 cited

PathFusion: Path-consistent Lidar-Camera Deep Feature Fusion

Lemeng Wu, Dilin Wang, Meng Li +4

Fusing 3D LiDAR features with 2D camera features is a promising technique for enhancing the accuracy of 3D detection, thanks to their complementary physical properties. While most…

cs.CV2022★ 4 cited

Neural Volumetric Mesh Generator

Yan Zheng, Lemeng Wu, Xingchao Liu +3

Deep generative models have shown success in generating 3D shapes with different representations. In this work, we propose Neural Volumetric Mesh Generator(NVMG) which can generate…

cs.LG2022★ 82 cited

Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow

Xingchao Liu, Chengyue Gong, Qiang Liu

We present rectified flow, a surprisingly simple approach to learning (neural) ordinary differential equation (ODE) models to transport between two empirically observed distributio…

cs.LG2022★ 19 cited

Diffusion-based Molecule Generation with Informative Prior Bridges

Lemeng Wu, Chengyue Gong, Xingchao Liu +2

AI-based molecule generation provides a promising approach to a large area of biomedical sciences and engineering, such as antibody design, hydrolase engineering, or vaccine develo…

cs.CV2022★ 151 cited

Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks

Wenhui Wang, Hangbo Bao, Li Dong +8

A big convergence of language, vision, and multimodal pretraining is emerging. In this work, we introduce a general-purpose multimodal foundation model BEiT-3, which achieves state…

cs.CV2021★ 288 cited

VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts

Hangbo Bao, Wenhui Wang, Li Dong +5

We present a unified Vision-Language pretrained Model (VLMo) that jointly learns a dual encoder and a fusion encoder with a modular Transformer network. Specifically, we introduce…