Micro Language Models Enable Instant Responses

Wen Cheng, Tuochao Chen, Karim Helwani +3

Edge devices such as smartwatches and smart glasses cannot continuously run even the smallest 100M-1B parameter language models due to power and compute constraints, yet cloud infe…