126 citations · 376 across the 37 of their papers we have counts for
11 papers · 1 filter
Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flows
Ruixiang Zhang, Shuangfei Zhai, Jiatao Gu +6
Autoregressive models have driven remarkable progress in language modeling. Their foundational reliance on discrete tokens, unidirectional context, and single-pass decoding, while…
Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation
Mingyuan Zhou, Huangjie Zheng, Zhendong Wang +2
We introduce Score identity Distillation (SiD), an innovative data-free method that distills the generative capabilities of pretrained diffusion models into a single-step generator…
Beta Diffusion
Mingyuan Zhou, Tianqi Chen, Zhendong Wang +1
We introduce beta diffusion, a novel generative modeling method that integrates demasking and denoising to generate data within bounded ranges. Using scaled and shifted beta distri…
POUF: Prompt-oriented unsupervised fine-tuning for large pre-trained models
Korawat Tanwisuth, Shujian Zhang, Huangjie Zheng +2
Through prompting, large-scale pre-trained models have become more expressive and powerful, gaining significant attention in recent years. Though these big models have zero-shot ca…
Diffusion-GAN: Training GANs with Diffusion
Zhendong Wang, Huangjie Zheng, Pengcheng He +2
Generative adversarial networks (GANs) are challenging to train stably, and a promising remedy of injecting instance noise into the discriminator input has not been very effective…
Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings
Dongsheng Wang, Dandan Guo, He Zhao +4
A topic model is often formulated as a generative model that explains how each word of a document is generated given a set of topics and document-specific topic proportions. It is…
Alignment Attention by Matching Key and Query Distributions
Shujian Zhang, Xinjie Fan, Huangjie Zheng +2
The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-atte…
A Prototype-Oriented Framework for Unsupervised Domain Adaptation
Korawat Tanwisuth, Xinjie Fan, Huangjie Zheng +4
Existing methods for unsupervised domain adaptation often rely on minimizing some statistical distance between the source and target samples in the latent space. To avoid the sampl…
Contrastive Attraction and Contrastive Repulsion for Representation Learning
Huangjie Zheng, Xu Chen, Jiangchao Yao +7
Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative sampl…
Learning on Attribute-Missing Graphs
Xu Chen, Siheng Chen, Jiangchao Yao +3
Graphs with complete node attributes have been widely explored recently. While in practice, there is a graph where attributes of only partial nodes could be available and those of…
MCMC-Interactive Variational Inference
Quan Zhang, Huangjie Zheng, Mingyuan Zhou
Leveraging well-established MCMC strategies, we propose MCMC-interactive variational inference (MIVI) to not only estimate the posterior in a time constrained manner, but also faci…