most citedHMoE: Heterogeneous Mixture of Experts for Language Modeling

2 citations · 2 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CL20242 cited

HMoE: Heterogeneous Mixture of Experts for Language Modeling

An Wang, Xingwu Sun, Ruobing Xie +9

Mixture of Experts (MoE) offers remarkable performance and computational efficiency by selectively activating subsets of model parameters. Traditionally, MoE models use homogeneous…

cs.AI2024

EasyQuant: An Efficient Data-free Quantization Algorithm for LLMs

Hanlin Tang, Yifu Sun, Decheng Wu +3

Large language models (LLMs) have proven to be very superior to conventional methods in various tasks. However, their expensive computations and high memory requirements are prohib…

cs.CL2024

Truth Forest: Toward Multi-Scale Truthfulness in Large Language Models through Intervention without Tuning

Zhongzhi Chen, Xingwu Sun, Xianfeng Jiao +4

Despite the great success of large language models (LLMs) in various tasks, they suffer from generating hallucinations. We introduce Truth Forest, a method that enhances truthfulne…

cs.IR2024

Plug-in Diffusion Model for Sequential Recommendation

Haokai Ma, Ruobing Xie, Lei Meng +4

Pioneering efforts have verified the effectiveness of the diffusion models in exploring the informative uncertainty for recommendation. Considering the difference between recommend…

cs.CV2023

TeachCLIP: Multi-Grained Teaching for Efficient Text-to-Video Retrieval

Kaibin Tian, Ruixiang Zhao, Hu Hu +4

For text-to-video retrieval (T2VR), which aims to retrieve unlabeled videos by ad-hoc textual queries, CLIP-based methods are dominating. Compared to CLIP4Clip which is efficient a…

cs.IR2023

Multi-Feature Integration for Perception-Dependent Examination-Bias Estimation

Xiaoshu Chen, Xiangsheng Li, Kunliang Wei +4

Eliminating examination bias accurately is pivotal to apply click-through data to train an unbiased ranking model. However, most examination-bias estimators are limited to the hypo…