1 citations · 1 across the 14 of their papers we have counts for
5 papers · 1 filter
Disentangled Representation Learning via Flow Matching
Jinjin Chi, Taoping Liu, Mengtao Yin +5
Disentangled representation learning aims to capture the underlying explanatory factors of observed data, enabling a principled understanding of the data-generating process. Recent…
CoVeR: Conformal Calibration for Versatile and Reliable Autoregressive Next-Token Prediction
Yuzhu Chen, Yingjie Wang, Shunyu Liu +2
Autoregressive pre-trained models combined with decoding methods have achieved impressive performance on complex reasoning tasks. While mainstream decoding strategies such as beam…
A Theoretical Perspective: How to Prevent Model Collapse in Self-consuming Training Loops
Shi Fu, Yingjie Wang, Yuzhu Chen +2
High-quality data is essential for training large generative models, yet the vast reservoir of real data available online has become nearly depleted. Consequently, models increasin…
HRP: High-Rank Preheating for Superior LoRA Initialization
Yuzhu Chen, Yingjie Wang, Shi Fu +4
This paper studies the crucial impact of initialization in Low-Rank Adaptation (LoRA). Through theoretical analysis, we demonstrate that the fine-tuned result of LoRA is highly sen…
A Theoretical Survey on Foundation Models
Shi Fu, Yuzhu Chen, Yingjie Wang +1
Understanding the inner mechanisms of black-box foundation models (FMs) is essential yet challenging in artificial intelligence and its applications. Over the last decade, the long…