109 citations · 318 across the 46 of their papers we have counts for
4 papers · 1 filter
NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs
Jiayue Jin, Jingwei Zhang, Chen Wang +2
Multimodal expansion of large language models (LLMs) enables new perceptual capabilities but often compromises the language intelligence acquired during pretraining. In this work,…
Ada-K Routing: Boosting the Efficiency of MoE-based LLMs
Tongtian Yue, Longteng Guo, Jie Cheng +2
In the era of Large Language Models (LLMs), Mixture-of-Experts (MoE) architectures offer a promising approach to managing computational costs while scaling up model parameters. Con…
Fast Sequence Generation with Multi-Agent Reinforcement Learning
Longteng Guo, Jing Liu, Xinxin Zhu +1
Autoregressive sequence Generation models have achieved state-of-the-art performance in areas like machine translation and image captioning. These models are autoregressive in that…
Non-Autoregressive Image Captioning with Counterfactuals-Critical Multi-Agent Learning
Longteng Guo, Jing Liu, Xinxin Zhu +3
Most image captioning models are autoregressive, i.e. they generate each word by conditioning on previously generated words, which leads to heavy latency during inference. Recently…