The Larger the Better? Improved LLM Code-Generation via Budget Reallocation

Michael Hassid, Tal Remez, Jonas Gehring +2

It is a common belief that large language models (LLMs) are better than smaller-sized ones. However, larger models also require significantly more time and compute during inference…