111 citations · 134 across the 9 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024★ 16 cited
FoRAG: Factuality-optimized Retrieval Augmented Generation for Web-enhanced Long-form Question Answering
Tianchi Cai, Zhiwen Tan, Xierui Song +5
Retrieval Augmented Generation (RAG) has become prevalent in question-answering (QA) tasks due to its ability of utilizing search engine to enhance the quality of long-form questio…
cs.LG2024
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
Zhitian Xie, Yinger Zhang, Chenyi Zhuang +4
The application of mixture-of-experts (MoE) is gaining popularity due to its ability to improve model's performance. In an MoE structure, the gate layer plays a significant role in…