167 citations · 457 across the 38 of their papers we have counts for
38 papers
Molecule Design by Latent Prompt Transformer
Deqian Kong, Yuhao Huang, Jianwen Xie +8
This work explores the challenging problem of molecule design by framing it as a conditional generative modeling task, where target biological properties or desired chemical constr…
Molecule Design by Latent Prompt Transformer
Deqian Kong, Yuhao Huang, Jianwen Xie +1
This paper proposes a latent prompt Transformer model for solving challenging optimization problems such as molecule design, where the goal is to find molecules with optimal values…
Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood
Yaxuan Zhu, Jianwen Xie, Yingnian Wu +1
Training energy-based models (EBMs) on high-dimensional data can be both challenging and time-consuming, and there exists a noticeable gap in sample quality between EBMs and other…
Progressive Energy-Based Cooperative Learning for Multi-Domain Image-to-Image Translation
Weinan Song, Yaxuan Zhu, Lei He +2
This paper studies a novel energy-based cooperative learning framework for multi-domain image-to-image translation. The framework consists of four components: descriptor, translato…
Likelihood-Based Generative Radiance Field with Latent Space Energy-Based Model for 3D-Aware Disentangled Image Representation
Yaxuan Zhu, Jianwen Xie, Ping Li
We propose the NeRF-LEBM, a likelihood-based top-down 3D-aware 2D image generative model that incorporates 3D representation via Neural Radiance Fields (NeRF) and 2D imaging proces…
CoopInit: Initializing Generative Adversarial Networks via Cooperative Learning
Yang Zhao, Jianwen Xie, Ping Li
Numerous research efforts have been made to stabilize the training of the Generative Adversarial Networks (GANs), such as through regularization and architecture design. However, w…
A Tale of Two Latent Flows: Learning Latent Space Normalizing Flow with Short-run Langevin Flow for Approximate Inference
Jianwen Xie, Yaxuan Zhu, Yifei Xu +2
We study a normalizing flow in the latent space of a top-down generator model, in which the normalizing flow model plays the role of the informative prior model of the generator. W…
CoopHash: Cooperative Learning of Multipurpose Descriptor and Contrastive Pair Generator via Variational MCMC Teaching for Supervised Image Hashing
Khoa D. Doan, Jianwen Xie, Yaxuan Zhu +2
Leveraging supervised information can lead to superior retrieval performance in the image hashing domain but the performance degrades significantly without enough labeled data. One…
A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Model
Jianwen Xie, Yaxuan Zhu, Jun Li +1
This paper studies the cooperative learning of two generative flow models, in which the two models are iteratively updated based on the jointly synthesized examples. The first flow…
An Energy-Based Prior for Generative Saliency
Jing Zhang, Jianwen Xie, Nick Barnes +1
We propose a novel generative saliency prediction framework that adopts an informative energy-based model as a prior distribution. The energy-based prior model is defined on the la…
Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction
Jing Zhang, Jianwen Xie, Nick Barnes +1
Vision transformer networks have shown superiority in many computer vision tasks. In this paper, we take a step further by proposing a novel generative vision transformer with late…
Blind Image Super-resolution with Elaborate Degradation Modeling on Noise and Kernel
Zongsheng Yue, Qian Zhao, Jianwen Xie +3
While researches on model-based blind single image super-resolution (SISR) have achieved tremendous successes recently, most of them do not consider the image degradation sufficien…
Energy-Based Generative Cooperative Saliency Prediction
Jing Zhang, Jianwen Xie, Zilong Zheng +1
Conventional saliency prediction models typically learn a deterministic mapping from an image to its saliency map, and thus fail to explain the subjective nature of human attention…
Semi-Supervised Video Deraining with Dynamical Rain Generator
Zongsheng Yue, Jianwen Xie, Qian Zhao +1
While deep learning (DL)-based video deraining methods have achieved significant success recently, they still exist two major drawbacks. Firstly, most of them do not sufficiently m…
Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation
Jianwen Xie, Zilong Zheng, Xiaolin Fang +2
This paper studies the unsupervised cross-domain translation problem by proposing a generative framework, in which the probability distribution of each domain is represented by a g…
Generative VoxelNet: Learning Energy-Based Models for 3D Shape Synthesis and Analysis
Jianwen Xie, Zilong Zheng, Ruiqi Gao +3
3D data that contains rich geometry information of objects and scenes is valuable for understanding 3D physical world. With the recent emergence of large-scale 3D datasets, it beco…
Learning Energy-Based Model with Variational Auto-Encoder as Amortized Sampler
Jianwen Xie, Zilong Zheng, Ping Li
Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient o…
Learning Noise-Aware Encoder-Decoder from Noisy Labels by Alternating Back-Propagation for Saliency Detection
Jing Zhang, Jianwen Xie, Nick Barnes
In this paper, we propose a noise-aware encoder-decoder framework to disentangle a clean saliency predictor from noisy training examples, where the noisy labels are generated by un…
On Path Integration of Grid Cells: Group Representation and Isotropic Scaling
Ruiqi Gao, Jianwen Xie, Xue-Xin Wei +2
Understanding how grid cells perform path integration calculations remains a fundamental problem. In this paper, we conduct theoretical analysis of a general representation model o…
Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification
Jianwen Xie, Yifei Xu, Zilong Zheng +2
We propose a generative model of unordered point sets, such as point clouds, in the form of an energy-based model, where the energy function is parameterized by an input-permutatio…
Representation Learning: A Statistical Perspective
Jianwen Xie, Ruiqi Gao, Erik Nijkamp +2
Learning representations of data is an important problem in statistics and machine learning. While the origin of learning representations can be traced back to factor analysis and…
Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns
Jianwen Xie, Ruiqi Gao, Zilong Zheng +2
Dynamic patterns are characterized by complex spatial and motion patterns. Understanding dynamic patterns requires a disentangled representational model that separates the factoria…
Learning Energy-based Spatial-Temporal Generative ConvNets for Dynamic Patterns
Jianwen Xie, Song-Chun Zhu, Ying Nian Wu
Video sequences contain rich dynamic patterns, such as dynamic texture patterns that exhibit stationarity in the temporal domain, and action patterns that are non-stationary in eit…
Learning Feature-to-Feature Translator by Alternating Back-Propagation for Generative Zero-Shot Learning
Yizhe Zhu, Jianwen Xie, Bingchen Liu +1
We investigate learning feature-to-feature translator networks by alternating back-propagation as a general-purpose solution to zero-shot learning (ZSL) problems. It is a generativ…