4 papers
Learning an Efficient Optimizer via Hybrid-Policy Sub-Trajectory Balance
Yunchuan Guan, Yu Liu, Ke Zhou +8
Recent advances in generative modeling enable neural networks to generate weights without relying on gradient-based optimization. However, current methods are limited by issues of…
Is Meta-Learning Out? Rethinking Unsupervised Few-Shot Classification with Limited Entropy
Yunchuan Guan, Yu Liu, Ke Zhou +4
Meta-learning is a powerful paradigm for tackling few-shot tasks. However, recent studies indicate that models trained with the whole-class training strategy can achieve comparable…
Gradient Imbalance in Direct Preference Optimization
Qinwei Ma, Jingzhe Shi, Can Jin +3
Direct Preference Optimization (DPO) has been proposed as a promising alternative to Proximal Policy Optimization (PPO) based Reinforcement Learning with Human Feedback (RLHF). How…
Learning to Learn Weight Generation via Local Consistency Diffusion
Yunchuan Guan, Yu Liu, Ke Zhou +3
Diffusion-based algorithms have emerged as promising techniques for weight generation. However, existing solutions are limited by two challenges: generalizability and local target…