activity
20182024
most citedBERT-ATTACK: Adversarial Attack Against BERT Using BERT

67 citations · 245 across the 29 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2024

Turn Waste into Worth: Rectifying Top- Router of MoE

Zhiyuan Zeng, Qipeng Guo, Zhaoye Fei +7

Sparse Mixture of Experts (MoE) models are popular for training large language models due to their computational efficiency. However, the commonly used top- routing mechanism su…