3.1k citations · 3.8k across the 25 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024★ 136 cited
Mixtral of Experts
Albert Q. Jiang, Alexandre Sablayrolles, Antoine Roux +23
We introduce Mixtral 8x7B, a Sparse Mixture of Experts (SMoE) language model. Mixtral has the same architecture as Mistral 7B, with the difference that each layer is composed of 8…
cs.LG2021★ 2 cited
How Many Data Points is a Prompt Worth?
Teven Le Scao, Alexander M. Rush
When fine-tuning pretrained models for classification, researchers either use a generic model head or a task-specific prompt for prediction. Proponents of prompting have argued tha…