The Law of Multi-Model Collaboration: Scaling Limits of Model Ensembling for Large Language Models

Dakuan Lu, Jiaqi Zhang, Cheng Yuan +2

Recent advances in large language models (LLMs) have been largely driven by scaling laws for individual models, which predict performance improvements as model parameters and data…