6 citations · 16 across the 13 of their papers we have counts for
4 papers · 1 filter
Breaking through the learning plateaus of in-context learning in Transformer
Jingwen Fu, Tao Yang, Yuwang Wang +2
In-context learning, i.e., learning from context examples, is an impressive ability of Transformer. Training Transformers to possess this in-context learning skill is computational…
Vector-based Representation is the Key: A Study on Disentanglement and Compositional Generalization
Tao Yang, Yuwang Wang, Cuiling Lan +2
Recognizing elementary underlying concepts from observations (disentanglement) and generating novel combinations of these concepts (compositional generalization) are fundamental ab…
Learning Trajectories are Generalization Indicators
Jingwen Fu, Zhizheng Zhang, Dacheng Yin +2
This paper explores the connection between learning trajectories of Deep Neural Networks (DNNs) and their generalization capabilities when optimized using (stochastic) gradient des…
Unifying Layout Generation with a Decoupled Diffusion Model
Mude Hui, Zhizheng Zhang, Xiaoyi Zhang +3
Layout generation aims to synthesize realistic graphic scenes consisting of elements with different attributes including category, size, position, and between-element relation. It…