Iterate on an LLM, Serve on an SLM

Keegan Wang

As frontier LLMs gain more capabilities, the cost to run them also goes up. At the same time, small language models (SLMs) also gain more capabilities but have largely been able to…