9 citations · 13 across the 9 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CL2023
DA-Cramming: Enhancing Cost-Effective Language Model Pretraining with Dependency Agreement Integration
Martin Kuo, Jianyi Zhang, Dongting Li +1
Pretraining language models is still a challenge for many researchers due to its substantial computational costs. As such, there is growing interest in developing more affordable p…
cs.CL2023★ 9 cited
Towards Building the Federated GPT: Federated Instruction Tuning
Jianyi Zhang, Saeed Vahidian, Martin Kuo +6
While "instruction-tuned" generative large language models (LLMs) have demonstrated an impressive ability to generalize to new tasks, the training phases heavily rely on large amou…