40 citations · 45 across the 4 of their papers we have counts for
4 papers
Harder Tasks Need More Experts: Dynamic Routing in MoE Models
Quzhe Huang, Zhenwei An, Nan Zhuang +7
In this paper, we introduce a novel dynamic expert selection framework for Mixture of Experts (MoE) models, aiming to enhance computational efficiency and model performance by adju…
A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models
Hejing Cao, Zhenwei An, Jiazhan Feng +3
While large language models exhibit remarkable performance in the Question Answering task, they are susceptible to hallucinations. Challenges arise when these models grapple with u…
Lawyer LLaMA Technical Report
Quzhe Huang, Mingxu Tao, Chen Zhang +5
Large Language Models (LLMs), like LLaMA, have exhibited remarkable performance across various tasks. Nevertheless, when deployed to specific domains such as law or medicine, the m…
Do Charge Prediction Models Learn Legal Theory?
Zhenwei An, Quzhe Huang, Cong Jiang +2
The charge prediction task aims to predict the charge for a case given its fact description. Recent models have already achieved impressive accuracy in this task, however, little i…