8 papers
ParVL: Parallel Scaling and Expandable Compute Allocation for Multimodal LLMs
Yang Yang, Qinyu Zhao, Mouxiang Chen +5
Existing scaling strategies for Multimodal Large Language Models (MLLMs) typically expand either model parameters or sequential inference computation, incurring substantial memory…
Continuous Latent Diffusion Language Model
Hongcan Guo, Qinyu Zhao, Yian Zhao +8
Large language models have achieved remarkable success under the autoregressive paradigm, yet high-quality text generation need not be tied to a fixed left-to-right order. Existing…
SimFlow: Simplified and End-to-End Training of Latent Normalizing Flows
Qinyu Zhao, Guangting Zheng, Tao Yang +4
Normalizing Flows (NFs) learn invertible mappings between the data and a Gaussian distribution. Prior works usually suffer from two limitations. First, they add random noise to tra…
FARMER: Flow AutoRegressive Transformer over Pixels
Guangting Zheng, Qinyu Zhao, Tao Yang +6
Directly modeling the explicit likelihood of the raw data distribution is key topic in the machine learning area, which achieves the scaling successes in Large Language Models by a…
Can We Predict Performance of Large Models across Vision-Language Tasks?
Qinyu Zhao, Ming Xu, Kartik Gupta +3
Evaluating large vision-language models (LVLMs) is very expensive, due to high computational cost and the wide variety of tasks. The good news is that if we already have some obser…
DiSA: Diffusion Step Annealing in Autoregressive Image Generation
Qinyu Zhao, Jaskirat Singh, Ming Xu +3
An increasing number of autoregressive models, such as MAR, FlowAR, xAR, and Harmon adopt diffusion sampling to improve the quality of image generation. However, this strategy lead…