12 citations · 23 across the 15 of their papers we have counts for
4 papers · 1 filter
MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devices
Xiangxiang Chu, Limeng Qiao, Xinyang Lin +8
We present MobileVLM, a competent multimodal vision language model (MMVLM) targeted to run on mobile devices. It is an amalgamation of a myriad of architectural designs and techniq…
Robust MAE-Driven NAS: From Mask Reconstruction to Architecture Innovation
Yiming Hu, Xiangxiang Chu, Yong Wang
Neural Architecture Search (NAS) relies heavily on labeled data, which is labor-intensive and time-consuming to obtain. In this paper, we propose a novel NAS method based on an uns…
ESRL: Efficient Sampling-based Reinforcement Learning for Sequence Generation
Chenglong Wang, Hang Zhou, Yimin Hu +5
Applying Reinforcement Learning (RL) to sequence generation models enables the direct optimization of long-term rewards (\textit{e.g.,} BLEU and human feedback), but typically requ…
Improved Knowledge Distillation for Pre-trained Language Models via Knowledge Selection
Chenglong Wang, Yi Lu, Yongyu Mu +3
Knowledge distillation addresses the problem of transferring knowledge from a teacher model to a student model. In this process, we typically have multiple types of knowledge extra…