7 papers
Improving Sample Diversity in Autoregressive Text-to-Image Generation via Cluster Truncation
Trang Nguyen, Shuang Wu, Runyan Tan +1
While diffusion models achieve state-of-the-art image quality for text-to-image (T2I) generation, recent work has demonstrated that they suffer from sample diversity collapse. In t…
p-less Sampling: A Robust Hyperparameter-Free Approach for LLM Decoding
Runyan Tan, Shuang Wu, Phillip Howard
Obtaining high-quality outputs from Large Language Models (LLMs) often depends upon the choice of a sampling-based decoding strategy to probabilistically choose the next token at e…
Safe Multitask Molecular Graph Networks for Vapor Pressure and Odor Threshold Prediction
Shuang Wu, Meijie Wang, Lun Yu
We investigate two important tasks in odor-related property modeling: Vapor Pressure (VP) and Odor Threshold (OP). To evaluate the model's out-of-distribution (OOD) capability, we…
Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbone
Jiacheng Ye, Shansan Gong, Jiahui Gao +6
While autoregressive Large Vision-Language Models (VLMs) have achieved remarkable success, their sequential generation often limits their efficacy in complex visual planning and dy…
Laplacian Kernelized Bandit
Shuang Wu, Arash A. Amini
We study multi-user contextual bandits where users are related by a graph and their reward functions exhibit both non-linear behavior and graph homophily. We introduce a principled…
MARS: Unleashing the Power of Variance Reduction for Training Large Models
Huizhuo Yuan, Yifeng Liu, Shuang Wu +2
Training deep neural networks--and more recently, large models demands efficient and scalable optimizers. Adaptive gradient algorithms like Adam, AdamW, and their variants have bee…