Quantifying the Capabilities of LLMs across Scale and Precision

Sher Badshah, Hassan Sajjad

Scale is often attributed as one of the factors that cause an increase in the performance of LLMs, resulting in models with billion and trillion parameters. One of the limitations…