9 papers
Recursive Learning Without Collapse: A Weighting-Based Stabilization Framework
Hengzhi He, Shirong Xu, Guang Cheng
Recent studies identified an intriguing phenomenon in recursive generative model training known as model collapse, where models trained on data generated by previous models exhibit…
Do More Predictions Improve Statistical Inference? Filtered Prediction-Powered Inference
Shirong Xu, Will Wei Sun
Recent advances in artificial intelligence have enabled the generation of large-scale, low-cost predictions with increasingly high fidelity. As a result, the primary challenge in s…
TimeAutoDiff: A Unified Framework for Generation, Imputation, Forecasting, and Time-Varying Metadata Conditioning of Heterogeneous Time Series Tabular Data
Namjoon Suh, Yuning Yang, Din-Yin Hsieh +4
We present TimeAutoDiff, a unified latent-diffusion framework for four fundamental time-series tasks: unconditional generation, missing-data imputation, forecasting, and time-varyi…
Optimal Watermark Generation under Type I and Type II Errors
Hengzhi He, Shirong Xu, Alexander Nemecek +3
Watermarking has recently emerged as a crucial tool for protecting the intellectual property of generative models and for distinguishing AI-generated content from human-generated d…
Human-Corrected Labels Learning: Enhancing Labels Quality via Human Correction of VLMs Discrepancies
Zhongnian Li, Lan Chen, Yixin Xu +2
Vision-Language Models (VLMs), with their powerful content generation capabilities, have been successfully applied to data annotation processes. However, the VLM-generated labels e…
A Probabilistic Perspective on Model Collapse
Shirong Xu, Hengzhi He, Guang Cheng
In recent years, model collapse has become a critical issue in language model training, making it essential to understand the underlying mechanisms driving this phenomenon. In this…