3 citations · 5 across the 9 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.AI2024
Automatically Planning Optimal Parallel Strategy for Large Language Models
Zongbiao Li, Xiezhao Li, Yinghao Cui +11
The number of parameters in large-scale language models based on transformers is gradually increasing, and the scale of computing clusters is also growing. The technology of quickl…
cs.CL2024★ 3 cited
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset
Shubham Toshniwal, Ivan Moshkov, Sean Narenthiran +3
Recent work has shown the immense potential of synthetically generated datasets for training large language models (LLMs), especially for acquiring targeted skills. Current large-s…