All Language Models Large and Small

Zhixun Chen, Yali Du, David Mguni

Many leading language models (LMs) use high-intensity computational resources both during training and execution. This poses the challenge of lowering resource costs for deployment…