32 citations · 50 across the 5 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.CL2024★ 1 cited
PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training
Rongjie Yi, Xiang Li, Weikai Xie +6
The interest in developing small language models (SLM) for on-device deployment is fast growing. However, the existing SLM design hardly considers the device hardware characteristi…
cs.CL2024★ 17 cited
Small Language Models: Survey, Measurements, and Insights
Zhenyan Lu, Xiang Li, Dongqi Cai +5
Small language models (SLMs), despite their widespread adoption in modern smart devices, have received significantly less academic attention compared to their large language model…
cs.LG2024★ 32 cited
A Survey of Resource-efficient LLM and Multimodal Foundation Models
Mengwei Xu, Wangsong Yin, Dongqi Cai +15
Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine lear…