Token-level Ensembling of Models with Different Vocabularies

Rachel Wicks, Kartik Ravisankar, Xinchen Yang +2

Model ensembling is a technique to combine the predicted distributions of two or more models, often leading to improved robustness and performance. For ensembling in text generatio…